-- Logs begin at Tue 2022-07-12 12:59:04 UTC, end at Tue 2022-07-12 14:00:29 UTC. -- Jul 12 13:26:32.354950 dv-cinder-797970-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 13:26:32.365872 dv-cinder-797970-4-smb devstack@keystone.service[80471]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 13:26:32 2022] *** Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: nodename: dv-cinder-797970-4-smb Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: machine: x86_64 Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: clock source: unix Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: pcre jit disabled Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: detected number of CPU cores: 4 Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: current working directory: / Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: detected binary path: /usr/bin/uwsgi-core Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: your processes number limit is 47680 Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: your memory page size is 4096 bytes Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: detected max file descriptor number: 2048 Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: lock engine: pthread robust mutexes Jul 12 13:26:32.367149 dv-cinder-797970-4-smb devstack@keystone.service[80471]: thunder lock: enabled Jul 12 13:26:32.367958 dv-cinder-797970-4-smb devstack@keystone.service[80471]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 13:26:32.367958 dv-cinder-797970-4-smb devstack@keystone.service[80471]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 13:26:32.411098 dv-cinder-797970-4-smb devstack@keystone.service[80471]: Python main interpreter initialized at 0x55d13fdcb9c0 Jul 12 13:26:32.411098 dv-cinder-797970-4-smb devstack@keystone.service[80471]: python threads support enabled Jul 12 13:26:32.411098 dv-cinder-797970-4-smb devstack@keystone.service[80471]: your server socket listen backlog is limited to 100 connections Jul 12 13:26:32.411098 dv-cinder-797970-4-smb devstack@keystone.service[80471]: your mercy for graceful operations on workers is 90 seconds Jul 12 13:26:32.411463 dv-cinder-797970-4-smb devstack@keystone.service[80471]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 13:26:32.411540 dv-cinder-797970-4-smb devstack@keystone.service[80471]: *** Operational MODE: preforking *** Jul 12 13:26:32.411820 dv-cinder-797970-4-smb devstack@keystone.service[80471]: *** uWSGI is running in multiple interpreter mode *** Jul 12 13:26:32.411820 dv-cinder-797970-4-smb devstack@keystone.service[80471]: spawned uWSGI master process (pid: 80471) Jul 12 13:26:32.412045 dv-cinder-797970-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 13:26:32.413088 dv-cinder-797970-4-smb devstack@keystone.service[80471]: spawned uWSGI worker 1 (pid: 80481, cores: 1) Jul 12 13:26:32.413088 dv-cinder-797970-4-smb devstack@keystone.service[80471]: spawned uWSGI worker 2 (pid: 80482, cores: 1) Jul 12 13:26:32.413088 dv-cinder-797970-4-smb devstack@keystone.service[80471]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 13:26:37.759095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:26:37.759095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: from cryptography.utils import int_from_bytes Jul 12 13:26:37.759899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:26:37.759899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: from cryptography.utils import int_from_bytes Jul 12 13:26:37.760075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:26:37.760075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: from cryptography.utils import int_from_bytes Jul 12 13:26:37.760505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 13:26:37.760505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: from cryptography.utils import int_from_bytes Jul 12 13:26:37.807476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:26:37.807670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:26:37.807899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] command line args: [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:26:37.808217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:26:37.808382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ================================================================================ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:26:37.808520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 13:26:37.808718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 13:26:37.808850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] admin_token = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.808933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] command line args: [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 13:26:37.809000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] config_dir = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.809133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 13:26:37.809274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.809358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ================================================================================ {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 13:26:37.809427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] config_source = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.809986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] admin_token = **** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] debug = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] config_dir = [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] config_source = [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810648 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] debug = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.810943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_config_append = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.811961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_dir = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] list_limit = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_file = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] log_config_append = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] log_dir = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] log_file = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.812918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.813967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.814997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.815071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.815205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.815281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.815353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.815476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.815566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.815873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.815994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] publish_errors = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] publish_errors = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.816968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] standard_threads = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.817925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] standard_threads = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_journal = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_json = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_stderr = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818600 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] use_syslog = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.818827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] use_journal = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.819007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] use_json = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.819128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.819207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] use_stderr = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.819288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.819368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] use_syslog = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.819451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.819524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 13:26:37.819732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.819855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.819950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.820054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.820172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.820353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.820486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.820567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.820646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.820818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.820955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.821992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.822073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.822235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.822330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.822468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.822556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.822697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.822784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.822938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.823975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.824156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.824236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.824404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.824494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.824640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.824722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.824895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.824976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.825157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.825245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.825384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.825466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.825614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.825704 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.825861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.825944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.826104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.826192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.826332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.826413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.826555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.826637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.826780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.826857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.827131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.827325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.827412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.827567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.827678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.827834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.827912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.828985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.829964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.830104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.830188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.830339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.830415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.830563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.830639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.830795 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.830886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.831974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.832995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.833125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.833236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.833355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.833430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.833573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.833650 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.833792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.833880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.834960 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.835080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.835191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.835281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.835432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.835516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.835694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.835777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.835933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.836958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.837102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.837239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.837324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.837402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.837561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.837643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.837791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.837869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.838939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.839985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.840136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.840210 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.840347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.840426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.840580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.840673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.840816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.840943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.841932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.842999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.843173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.843250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.843404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.843481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.843647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.external = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.843742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.843874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.843952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.844162 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.844238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.844386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.844474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] auth.external = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.844610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.password = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.844701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.844839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] auth.token = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.844917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.845070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.845156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.845299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.845386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] auth.password = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.845548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.845628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] auth.token = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.845774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.845853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.846958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.847036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.847189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.847266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.847429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] credential.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.847516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.847680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.847762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.847922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.848965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.849126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.849205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.849383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.849461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.849622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.849713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.849876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.849962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.850114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.850194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.850363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.850450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.850592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.850679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.850822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.850901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.851062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.851148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.851302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.851381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] federation.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.851526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.851635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.851791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.851887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.852968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.853051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.853207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.853294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.853435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.853513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.853676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.853754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.853919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.854925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.855077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.855160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.855320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.855400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.855551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.855676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.855802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.855889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.856959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.857037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.857203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.857281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.857444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.857584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.857690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.857768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.857924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.858003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.858173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.858255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.858408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.858624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.858702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.858939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.859025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.859183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.859334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.859412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.859683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.859765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.859920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.860156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.860241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.860564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.860654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.860810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.860979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.861065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.861291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.861424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.861728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.861972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.862223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.862472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.862705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.862885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.863017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.863203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.863669 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.863949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.864222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.864302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.864499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.864746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.865042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.865189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.865321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.865603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.865733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.865843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.866018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.866146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.866340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.866470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.866715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.866976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.867213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.867453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.867714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.867830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.867948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.868095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.868189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.868357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.868436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.868612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.868691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.868864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.868951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.869117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.869195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.869362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.869440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.869593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.869673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.869820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.869899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.870978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.871058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.871223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.871301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.871465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.871542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.871724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.871805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.871966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.872973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.873123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.873203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.873351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.873430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.873586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.873663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.873874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.873955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.874113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.874192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.874364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.874443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.874589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.874668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.874835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.874915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.875075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.875154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.875306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.875387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.875539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.875665 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.875804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.875882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.876970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.877048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.877215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.877294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.877447 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.877533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.877692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.877772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.877921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.878946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.879142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] role.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.879291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.879514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] role.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.879593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.879772 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.879854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] resource.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.880986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.881063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.881226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.881305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.881467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.881546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.881711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.881789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.881939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] role.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.882978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] role.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.883134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.883296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.883377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.883526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.883623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.883796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.883875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.884038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.884118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.884281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.884359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.884522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.884601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.884757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.884839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.885940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.886019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.886166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.886250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.886411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.886596 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.886675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.886835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.886922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.887095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.887174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.887326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.887403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.887551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.887666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.887883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.888073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.888282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.888386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.888543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.888629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.888781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.888860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.889993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.890072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.890236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.890315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.890467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.890555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.890699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.890778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.890929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.891006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.891167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.891294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] token.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.891408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.891495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.891680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.891776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.891922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.892020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.892186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.892266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.892438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.892517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.892680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.892767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.892921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.893930 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.894080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.894159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.894311 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.894398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.894550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.894630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.894779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.894856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.connection = **** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.895978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.896058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.896202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.896281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.896433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.896519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.896662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.896744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.896816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80481) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:26:37.896953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.897192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.897429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.897677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.897914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.898159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.898394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.898641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.898879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.899123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.899354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.899593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.899847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 13:26:37.900020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80482) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 13:26:37.927551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.927748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.927972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.930071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.930305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.930535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.937167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.939526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.964859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.965132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.965661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:37.965894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.112870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.113490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.161531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.161939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.162290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.162539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.225809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.225950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.226875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.227061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.251711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.251908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.252923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.253079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.253301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.253521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.263937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.264779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.276765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.277945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.278058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80481) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.278138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.278292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.278509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80482) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 13:26:38.295464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.295814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 13:26:38.296163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.296323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.296438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 13:26:38.296518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 13:26:38.296581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.296853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.296975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.297045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 13:26:38.297120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.297325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.297453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.297562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.297851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.298108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.308096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.308362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.308621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.308892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.309035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.309190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.309465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.310075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.317465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.318390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.320712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.320991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.321270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.321590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.321789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.321978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.322102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.322258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.322369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.322524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.322642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.322796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.322906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.323025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.323182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.323263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.323384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.323553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.323646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.323798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.324077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.324347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.349827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.350798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.351411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.351705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.352442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.352725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.357182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.357461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.357850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.357973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.358286 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.358690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.365987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.366282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.368360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.368853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.370767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.371034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.371339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.371805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.372148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.372430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.372703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.372983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.375760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.376252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.376726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.377169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.377595 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.378035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.378306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.378811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.391956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.392224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.397450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.397728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.397872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.401988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.402281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.402406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.405928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.406219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.408374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.411290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.412006 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.414870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.415636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.415943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.416240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.416533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.416820 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.417111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.418491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.418783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.419070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.419368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.419636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.419925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.436747 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.437033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.437304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.438573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.439555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.439863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.440123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.440392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.446498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.448198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.448328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.448455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.449880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.450146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.451655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.452012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.452318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.452605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.452897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.453451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.453733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.454018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.454279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.454565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.466119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.466396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.466680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.466963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.467254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.467807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.468083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.468361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.468644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.468917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.469041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.469326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.470613 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.470910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.487275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.488671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.490530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.491936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.493850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.495185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.495589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.496928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.497261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.497541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.497833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.498539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.498857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.499146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.505233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.506353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.507075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.507967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.510311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.510602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.510995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.511119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.511255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.511431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.511837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.512118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.520392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.520678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.520960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.521104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.521406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.521684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.528824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80482) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.529100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.529380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.529504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80481) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 13:26:38.529654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.529780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.529934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.530094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.530193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.530387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.530512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.530635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.530845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.530989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.531134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.531260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.531384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.531529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.531673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.531765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.531958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.532080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.532218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.532306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.532479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.532602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80482) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.532747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.533020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80481) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 13:26:38.570417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d13fdcb9c0 pid: 80482 (default app) Jul 12 13:26:38.570914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d13fdcb9c0 pid: 80481 (default app) Jul 12 13:26:38.573821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d08b32-c2f0-4640-9f44-b42214bd5de5 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:38.574115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d08b32-c2f0-4640-9f44-b42214bd5de5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:38.574397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d08b32-c2f0-4640-9f44-b42214bd5de5 None None] PATH_INFO: `/v3` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:38.578687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Tue Jul 12 13:26:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:46.231138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404e89-6788-400b-b2ae-e5562df1458e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:46.231771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404e89-6788-400b-b2ae-e5562df1458e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:46.231771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d404e89-6788-400b-b2ae-e5562df1458e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:46.236157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:26:46.242810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:46.243544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:46.243686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:46.314427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: INFO dbcounter [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] Registered counter for database keystone Jul 12 13:26:46.339571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG oslo_db.sqlalchemy.engines [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:46.348343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writer thread running {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:46.527807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG passlib.handlers.bcrypt [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80482) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 13:26:46.528134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG passlib.handlers.bcrypt [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80482) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 13:26:46.583463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:46.585120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:46.723193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 13:26:46.927905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404e89-6788-400b-b2ae-e5562df1458e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:47.013444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: INFO dbcounter [None req-9d404e89-6788-400b-b2ae-e5562df1458e None None] Registered counter for database keystone Jul 12 13:26:47.034851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG oslo_db.sqlalchemy.engines [None req-9d404e89-6788-400b-b2ae-e5562df1458e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80481) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 13:26:47.046760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writer thread running {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 13:26:47.171288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d404e89-6788-400b-b2ae-e5562df1458e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:47.176917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0df0df-1be9-43f0-8e01-639269947e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:47.177586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0df0df-1be9-43f0-8e01-639269947e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:47.177871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0df0df-1be9-43f0-8e01-639269947e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:47.178203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0df0df-1be9-43f0-8e01-639269947e22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:47.187571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0df0df-1be9-43f0-8e01-639269947e22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:47.238737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cc0df0df-1be9-43f0-8e01-639269947e22 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 13:26:47.239302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0df0df-1be9-43f0-8e01-639269947e22 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:47.249383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Tue Jul 12 13:26:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:26:47.256085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:47.270976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85daf29d-e3fd-4504-a7f4-feb2b0432d18 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:47.276692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29b1e8-4e29-471a-a5de-6a2391d6706e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:47.277851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b1e8-4e29-471a-a5de-6a2391d6706e admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:47.278143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b1e8-4e29-471a-a5de-6a2391d6706e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:47.278417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29b1e8-4e29-471a-a5de-6a2391d6706e admin admin] PATH_INFO: `/v3/projects/0d8758be35b84eb491917415afdbf67c` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:47.282759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29b1e8-4e29-471a-a5de-6a2391d6706e admin admin] RBAC: Authorizing `identity:get_project(project_id=0d8758be35b84eb491917415afdbf67c)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:47.332861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea29b1e8-4e29-471a-a5de-6a2391d6706e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 13:26:47.333201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea29b1e8-4e29-471a-a5de-6a2391d6706e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:47.338693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Tue Jul 12 13:26:47 2022] GET /identity/v3/projects/0d8758be35b84eb491917415afdbf67c => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:26:49.312116 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce4346-6176-4634-9b30-08d799dc8ec2 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:49.312681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce4346-6176-4634-9b30-08d799dc8ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:49.312681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce4346-6176-4634-9b30-08d799dc8ec2 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:49.316797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:26:49.323325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1d9a4-732f-471b-8d62-fe20cc08dfb5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:49.323784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1d9a4-732f-471b-8d62-fe20cc08dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:49.323980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d1d9a4-732f-471b-8d62-fe20cc08dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:49.350941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-26d1d9a4-732f-471b-8d62-fe20cc08dfb5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:49.352531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-26d1d9a4-732f-471b-8d62-fe20cc08dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:49.361766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 13:26:49.385021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce4346-6176-4634-9b30-08d799dc8ec2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:49.401470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce4346-6176-4634-9b30-08d799dc8ec2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:49.410111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c9837-aba6-4aeb-84e0-8262a9ce3acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:49.411078 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c9837-aba6-4aeb-84e0-8262a9ce3acf admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:49.411508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c9837-aba6-4aeb-84e0-8262a9ce3acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:49.411996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c9837-aba6-4aeb-84e0-8262a9ce3acf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:49.423797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c9837-aba6-4aeb-84e0-8262a9ce3acf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:49.425634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c9837-aba6-4aeb-84e0-8262a9ce3acf admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:49.435371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Tue Jul 12 13:26:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:26:49.444513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1d9a4-732f-471b-8d62-fe20cc08dfb5 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:49.456934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d1d9a4-732f-471b-8d62-fe20cc08dfb5 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:49.463583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218856a-3015-4748-8d0e-5880573a00cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:49.464512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218856a-3015-4748-8d0e-5880573a00cb admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:49.464801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218856a-3015-4748-8d0e-5880573a00cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:49.465086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218856a-3015-4748-8d0e-5880573a00cb admin admin] PATH_INFO: `/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:49.466739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218856a-3015-4748-8d0e-5880573a00cb admin admin] RBAC: Authorizing `identity:get_user(user_id=3b4c5b191aab43d1b1bbd3832a632cc1)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:49.468726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218856a-3015-4748-8d0e-5880573a00cb admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:49.470317 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Tue Jul 12 13:26:49 2022] GET /identity/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:51.528902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0d7b6-54d7-42ad-a42e-59314fdb017a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:51.529451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0d7b6-54d7-42ad-a42e-59314fdb017a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:51.529451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0d7b6-54d7-42ad-a42e-59314fdb017a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:51.530963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:26:51.536299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7770ee-f72b-427b-b77a-5725cfadd62d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:51.536732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7770ee-f72b-427b-b77a-5725cfadd62d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:51.536821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7770ee-f72b-427b-b77a-5725cfadd62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:51.553774 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3f7770ee-f72b-427b-b77a-5725cfadd62d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:51.554948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3f7770ee-f72b-427b-b77a-5725cfadd62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:51.576310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f488be-6d71-45df-aa61-e1850d52bdfa None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:51.576592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f488be-6d71-45df-aa61-e1850d52bdfa None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:51.576843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f488be-6d71-45df-aa61-e1850d52bdfa None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:51.578849 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:26:51.584389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:51.584683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:51.584959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:51.626488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG passlib.handlers.bcrypt [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80481) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 13:26:51.626945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG passlib.handlers.bcrypt [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80481) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 13:26:51.643620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:26:51.666555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7770ee-f72b-427b-b77a-5725cfadd62d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:51.676578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:51.678234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:51.692448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:51.772428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7770ee-f72b-427b-b77a-5725cfadd62d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:51.779542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:26:51.801666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:51.808438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ef8f1-fcd7-48b3-9cbd-2cfd0648d504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:51.809262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ef8f1-fcd7-48b3-9cbd-2cfd0648d504 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:51.809886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ef8f1-fcd7-48b3-9cbd-2cfd0648d504 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:51.810155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ef8f1-fcd7-48b3-9cbd-2cfd0648d504 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:51.822251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2ef8f1-fcd7-48b3-9cbd-2cfd0648d504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-8e2ef8f1-fcd7-48b3-9cbd-2cfd0648d504 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:26:51.833569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:26:51.834554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:26:51.835522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:26:51.840592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ef8f1-fcd7-48b3-9cbd-2cfd0648d504 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:51.904274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364a476-de44-4658-85de-8071fa1078c9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:51.906602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:51.925329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:51.942153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5492b-f501-4140-867c-7799eb30ac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:51.943077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5492b-f501-4140-867c-7799eb30ac96 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:51.943358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5492b-f501-4140-867c-7799eb30ac96 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:51.943654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5492b-f501-4140-867c-7799eb30ac96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:51.944334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2ef8f1-fcd7-48b3-9cbd-2cfd0648d504 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:51.981138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:51.981814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:51.982093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:51.982377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:51.983158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:26:51.983466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:51.984942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:51.996883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:26:52.002686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:52.011908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5492b-f501-4140-867c-7799eb30ac96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:52.013455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a5492b-f501-4140-867c-7799eb30ac96 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:52.101655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8399a29-57c0-46f1-b2c7-3512a20b7dc6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:52.117590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:26:52.123451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5492b-f501-4140-867c-7799eb30ac96 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:52.126419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:52.143530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d440ef-33f5-472e-9e30-94b3b2dd7a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:52.144479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d440ef-33f5-472e-9e30-94b3b2dd7a86 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:52.144769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d440ef-33f5-472e-9e30-94b3b2dd7a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:52.145064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d440ef-33f5-472e-9e30-94b3b2dd7a86 None admin] PATH_INFO: `/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:52.146348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d440ef-33f5-472e-9e30-94b3b2dd7a86 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4c5b191aab43d1b1bbd3832a632cc1)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:52.147888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d440ef-33f5-472e-9e30-94b3b2dd7a86 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:52.149558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:26:52 2022] GET /identity/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:52.155955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d440ef-33f5-472e-9e30-94b3b2dd7a86 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:52.171452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:52.224037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5492b-f501-4140-867c-7799eb30ac96 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:52.256320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d440ef-33f5-472e-9e30-94b3b2dd7a86 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:52.256833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:52.257654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:52.257926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:52.258200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:52.276633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:52.278115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:52.289429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fc85f-f34f-4bb9-8840-8f6699e7b3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:52.290250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fc85f-f34f-4bb9-8840-8f6699e7b3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:52.290532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fc85f-f34f-4bb9-8840-8f6699e7b3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:52.290807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91fc85f-f34f-4bb9-8840-8f6699e7b3f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:52.292010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fc85f-f34f-4bb9-8840-8f6699e7b3f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:52.293464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91fc85f-f34f-4bb9-8840-8f6699e7b3f2 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:52.295089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:26:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:26:52.299685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:26:52.300555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:26:52.301367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:26:52.301367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:26:52.301367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:26:52.301367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:26:52.301566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fc85f-f34f-4bb9-8840-8f6699e7b3f2 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:52.301638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:26:52.306585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:52.362658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:52.382649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:52.404721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91fc85f-f34f-4bb9-8840-8f6699e7b3f2 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:52.408608 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aaf85d-739a-4a7b-a1c0-0f9f4dd6d073 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:52.442340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fce82-034e-4531-aee6-5eb0a16d54c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:52.443007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fce82-034e-4531-aee6-5eb0a16d54c9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:52.443288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fce82-034e-4531-aee6-5eb0a16d54c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:52.443562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fce82-034e-4531-aee6-5eb0a16d54c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:52.444480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fce82-034e-4531-aee6-5eb0a16d54c9 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.domain.id=default, user.id=3b4c5b191aab43d1b1bbd3832a632cc1) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:26:52.444792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fce82-034e-4531-aee6-5eb0a16d54c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:52.444896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13402b2-ff92-4059-8ccf-84fe2ae41b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:52.445565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13402b2-ff92-4059-8ccf-84fe2ae41b54 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:52.445851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13402b2-ff92-4059-8ccf-84fe2ae41b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:52.446132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13402b2-ff92-4059-8ccf-84fe2ae41b54 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:52.446243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fce82-034e-4531-aee6-5eb0a16d54c9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:52.446865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13402b2-ff92-4059-8ccf-84fe2ae41b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:26:52.447186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13402b2-ff92-4059-8ccf-84fe2ae41b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:52.448603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13402b2-ff92-4059-8ccf-84fe2ae41b54 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:52.453271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Tue Jul 12 13:26:52 2022] GET /identity/v3/role_assignments?user.id=3b4c5b191aab43d1b1bbd3832a632cc1&scope.domain.id=default&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:26:52.466953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:54.629966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e7c0a-dbfb-4df2-bdfb-e887902e8c1b None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:54.630485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e7c0a-dbfb-4df2-bdfb-e887902e8c1b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:54.630558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e7c0a-dbfb-4df2-bdfb-e887902e8c1b None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:54.632098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:26:54.637302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac5208-3f2b-42db-918d-8eb4e2b548a5 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:54.638149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac5208-3f2b-42db-918d-8eb4e2b548a5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:54.638615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac5208-3f2b-42db-918d-8eb4e2b548a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:54.643304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9da4ed-980f-4498-82ab-2e5e2c72520c None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:54.643891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9da4ed-980f-4498-82ab-2e5e2c72520c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:54.644368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9da4ed-980f-4498-82ab-2e5e2c72520c None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:54.645929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 13/23] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:26:54.651275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c7ef-f559-4db0-9afb-0f12f0afbe46 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:54.651845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c7ef-f559-4db0-9afb-0f12f0afbe46 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:54.652331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61c7ef-f559-4db0-9afb-0f12f0afbe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:54.669989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3f61c7ef-f559-4db0-9afb-0f12f0afbe46 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:54.671690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3f61c7ef-f559-4db0-9afb-0f12f0afbe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:54.672882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-caac5208-3f2b-42db-918d-8eb4e2b548a5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:54.674317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-caac5208-3f2b-42db-918d-8eb4e2b548a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:54.774668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 11/24] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:26:54.796100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 14/25] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:26:54.800201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac5208-3f2b-42db-918d-8eb4e2b548a5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:54.831570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61c7ef-f559-4db0-9afb-0f12f0afbe46 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:54.879387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:54.961358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:54.992457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac5208-3f2b-42db-918d-8eb4e2b548a5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:55.024743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f61c7ef-f559-4db0-9afb-0f12f0afbe46 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:55.080856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd122be-ad2a-4416-b89f-c8804bdb668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:55.081944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd122be-ad2a-4416-b89f-c8804bdb668c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.082374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd122be-ad2a-4416-b89f-c8804bdb668c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.082779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd122be-ad2a-4416-b89f-c8804bdb668c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.101181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:55.102406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.102838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.103285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.116920 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd122be-ad2a-4416-b89f-c8804bdb668c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:26:55.124159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:55.126167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7bd122be-ad2a-4416-b89f-c8804bdb668c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:26:55.136069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:26:55.137176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:26:55.138128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:26:55.138970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 12/26] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:26:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:26:55.146150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd122be-ad2a-4416-b89f-c8804bdb668c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:26:55.179095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:26:55.180196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:26:55.181225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:26:55.181225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:26:55.181225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:26:55.181225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:26:55.182862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 15/27] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:26:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:26:55.189942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:55.383000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ee837-0ceb-4270-ba57-b30c1dd546b8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:55.387966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd122be-ad2a-4416-b89f-c8804bdb668c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:55.407918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:55.434987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:55.447832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739f318-ae87-4102-bfe3-59f815d092ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:55.448123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c40ea2-ab4b-4435-b045-5f40826ac671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:55.448820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40ea2-ab4b-4435-b045-5f40826ac671 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.449107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40ea2-ab4b-4435-b045-5f40826ac671 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.449349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739f318-ae87-4102-bfe3-59f815d092ab None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.449445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c40ea2-ab4b-4435-b045-5f40826ac671 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.449879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739f318-ae87-4102-bfe3-59f815d092ab None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.450141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c40ea2-ab4b-4435-b045-5f40826ac671 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:26:55.450456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c40ea2-ab4b-4435-b045-5f40826ac671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:55.450683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739f318-ae87-4102-bfe3-59f815d092ab None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.451657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739f318-ae87-4102-bfe3-59f815d092ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:26:55.451970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c40ea2-ab4b-4435-b045-5f40826ac671 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:55.452438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739f318-ae87-4102-bfe3-59f815d092ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:55.454259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739f318-ae87-4102-bfe3-59f815d092ab None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:55.465956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 13/28] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:26:55.467547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c3a4-f85f-4748-a633-3293ec7f9f1f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.468001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c3a4-f85f-4748-a633-3293ec7f9f1f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.468418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c3a4-f85f-4748-a633-3293ec7f9f1f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.470460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 14/29] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:26:55.471729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3b68-4a92-4e05-bde1-a37a01f8d6d1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.472154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3b68-4a92-4e05-bde1-a37a01f8d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.472569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b3b68-4a92-4e05-bde1-a37a01f8d6d1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.474515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 15/30] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:26:55.477987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 16/31] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:55.479648 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1589a-c900-45fa-916d-c1c72c42e39f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.480116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1589a-c900-45fa-916d-c1c72c42e39f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.480578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b1589a-c900-45fa-916d-c1c72c42e39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.482329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b3b68-4a92-4e05-bde1-a37a01f8d6d1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:55.502134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-75b1589a-c900-45fa-916d-c1c72c42e39f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:55.503370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-75b1589a-c900-45fa-916d-c1c72c42e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:55.578083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 17/32] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:26:55.579225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1589a-c900-45fa-916d-c1c72c42e39f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:55.607125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b3b68-4a92-4e05-bde1-a37a01f8d6d1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:55.643227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac8300-fa62-4c0d-8531-78170693ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:55.644848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8300-fa62-4c0d-8531-78170693ebce None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.645267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8300-fa62-4c0d-8531-78170693ebce None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.645670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8300-fa62-4c0d-8531-78170693ebce None admin] PATH_INFO: `/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.647507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac8300-fa62-4c0d-8531-78170693ebce None admin] RBAC: Authorizing `identity:get_user(user_id=3b4c5b191aab43d1b1bbd3832a632cc1)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:55.649169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac8300-fa62-4c0d-8531-78170693ebce None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:55.651453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 16/33] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:26:55 2022] GET /identity/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:55.664214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6d14-3dc4-4d3c-b3f9-9f8f84f4d8d4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.664214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6d14-3dc4-4d3c-b3f9-9f8f84f4d8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.664214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b6d14-3dc4-4d3c-b3f9-9f8f84f4d8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.675208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-590b6d14-3dc4-4d3c-b3f9-9f8f84f4d8d4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:55.676759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-590b6d14-3dc4-4d3c-b3f9-9f8f84f4d8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:55.697955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b1589a-c900-45fa-916d-c1c72c42e39f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:55.707986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:55.718585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:55.739381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa60a93-3f75-4373-bf9f-52fb32bea595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:55.740271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa60a93-3f75-4373-bf9f-52fb32bea595 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.740573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa60a93-3f75-4373-bf9f-52fb32bea595 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.741046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa60a93-3f75-4373-bf9f-52fb32bea595 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.741787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa60a93-3f75-4373-bf9f-52fb32bea595 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:55.743455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa60a93-3f75-4373-bf9f-52fb32bea595 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:55.751659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 17/34] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:26:55.752795 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b6d14-3dc4-4d3c-b3f9-9f8f84f4d8d4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:55.867526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b6d14-3dc4-4d3c-b3f9-9f8f84f4d8d4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:55.886819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 18/35] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:26:55 2022] POST /identity/v3/projects => generated 301 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:26:55.888169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa60a93-3f75-4373-bf9f-52fb32bea595 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:55.908507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5b7f8-ad34-4dd4-8cce-a678f68b7c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:55.909703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5b7f8-ad34-4dd4-8cce-a678f68b7c76 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:55.910617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5b7f8-ad34-4dd4-8cce-a678f68b7c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:55.911041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5b7f8-ad34-4dd4-8cce-a678f68b7c76 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:55.912243 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5b7f8-ad34-4dd4-8cce-a678f68b7c76 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:55.914433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5b7f8-ad34-4dd4-8cce-a678f68b7c76 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:56.015557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa60a93-3f75-4373-bf9f-52fb32bea595 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:56.049086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 18/36] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 12 13:26:55 2022] POST /identity/v3/roles => generated 225 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:26:56.050444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5b7f8-ad34-4dd4-8cce-a678f68b7c76 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:56.066711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889fb7-2239-4553-b0a1-f9a66f591078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:56.067558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889fb7-2239-4553-b0a1-f9a66f591078 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.067874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889fb7-2239-4553-b0a1-f9a66f591078 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.068151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d889fb7-2239-4553-b0a1-f9a66f591078 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.069584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889fb7-2239-4553-b0a1-f9a66f591078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:56.071425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d889fb7-2239-4553-b0a1-f9a66f591078 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:56.073279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 19/37] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:26:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:56.083178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889fb7-2239-4553-b0a1-f9a66f591078 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:56.092764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:56.148711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:56.183461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5b7f8-ad34-4dd4-8cce-a678f68b7c76 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:56.222942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7a591-83ed-441b-a19c-2ca248bceb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:56.224175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7a591-83ed-441b-a19c-2ca248bceb9e None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.224649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7a591-83ed-441b-a19c-2ca248bceb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.225216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7a591-83ed-441b-a19c-2ca248bceb9e None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.226179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7a591-83ed-441b-a19c-2ca248bceb9e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:56.228014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7a591-83ed-441b-a19c-2ca248bceb9e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:56.246028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 19/38] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 12 13:26:56 2022] POST /identity/v3/roles => generated 219 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:26:56.250882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d889fb7-2239-4553-b0a1-f9a66f591078 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:56.290124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b923f-7359-4da2-971f-4c171a6c50e1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.290886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b923f-7359-4da2-971f-4c171a6c50e1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.291370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b923f-7359-4da2-971f-4c171a6c50e1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.293294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 20/39] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:26:56.299670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba967d6-7b44-4a83-aaa3-6e856841808a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.300379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba967d6-7b44-4a83-aaa3-6e856841808a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.300878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba967d6-7b44-4a83-aaa3-6e856841808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.338174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cba967d6-7b44-4a83-aaa3-6e856841808a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:56.341697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cba967d6-7b44-4a83-aaa3-6e856841808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:56.419627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c284a47-f14a-4d27-84b3-02d113b9ef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:56.419627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284a47-f14a-4d27-84b3-02d113b9ef94 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.419627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284a47-f14a-4d27-84b3-02d113b9ef94 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.419627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c284a47-f14a-4d27-84b3-02d113b9ef94 None admin] PATH_INFO: `/v3/domains/default/users/3b4c5b191aab43d1b1bbd3832a632cc1/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.420040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c284a47-f14a-4d27-84b3-02d113b9ef94 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3b4c5b191aab43d1b1bbd3832a632cc1, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:56.421483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c284a47-f14a-4d27-84b3-02d113b9ef94 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:56.450112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 20/40] 10.222.0.64 () {58 vars in 1361 bytes} [Tue Jul 12 13:26:56 2022] PUT /identity/v3/domains/default/users/3b4c5b191aab43d1b1bbd3832a632cc1/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:26:56.470184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 21/41] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:26:56.493273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c284a47-f14a-4d27-84b3-02d113b9ef94 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:56.608695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:56.615442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c284a47-f14a-4d27-84b3-02d113b9ef94 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:56.657130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5223ee4-a82b-4b0b-9ad9-b075ef8de6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:56.657829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5223ee4-a82b-4b0b-9ad9-b075ef8de6d3 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.658119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5223ee4-a82b-4b0b-9ad9-b075ef8de6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.658395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5223ee4-a82b-4b0b-9ad9-b075ef8de6d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.659173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5223ee4-a82b-4b0b-9ad9-b075ef8de6d3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:56.660608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5223ee4-a82b-4b0b-9ad9-b075ef8de6d3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:56.681349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 21/42] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 12 13:26:56 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:26:56.794405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21fb0-d387-4c2d-b39e-28087e041e04 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.794902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21fb0-d387-4c2d-b39e-28087e041e04 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.794974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21fb0-d387-4c2d-b39e-28087e041e04 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.796496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 22/43] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:26:56.802321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe79cf-7800-428e-abe3-4c296ca2e7a2 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:56.802809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe79cf-7800-428e-abe3-4c296ca2e7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:56.802902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe79cf-7800-428e-abe3-4c296ca2e7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:56.821850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6cbe79cf-7800-428e-abe3-4c296ca2e7a2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:56.823364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6cbe79cf-7800-428e-abe3-4c296ca2e7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:56.895327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 22/44] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:26:56.918057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c21fb0-d387-4c2d-b39e-28087e041e04 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:56.936590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:57.021954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c21fb0-d387-4c2d-b39e-28087e041e04 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:57.057180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63ce1f-9214-4c02-8393-014324eeec5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:57.057942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ce1f-9214-4c02-8393-014324eeec5f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:57.058235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ce1f-9214-4c02-8393-014324eeec5f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:57.058511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63ce1f-9214-4c02-8393-014324eeec5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:57.060082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63ce1f-9214-4c02-8393-014324eeec5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:57.061605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63ce1f-9214-4c02-8393-014324eeec5f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:57.063303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 23/45] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:57.070289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe79cf-7800-428e-abe3-4c296ca2e7a2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:57.158133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:57.175371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe79cf-7800-428e-abe3-4c296ca2e7a2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:57.211722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298ba22-f9d7-4662-8b2a-6242920eea1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:57.212511 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ba22-f9d7-4662-8b2a-6242920eea1c None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:57.212796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ba22-f9d7-4662-8b2a-6242920eea1c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:57.213070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298ba22-f9d7-4662-8b2a-6242920eea1c None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:57.213795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298ba22-f9d7-4662-8b2a-6242920eea1c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:57.215291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298ba22-f9d7-4662-8b2a-6242920eea1c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:57.240664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:26:57 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:26:58.488411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f39aa-cbcb-4340-91ee-5091913d992b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:58.489011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f39aa-cbcb-4340-91ee-5091913d992b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:58.489011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05f39aa-cbcb-4340-91ee-5091913d992b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:58.490348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:26:58.495850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3633-21e7-41a4-936f-7f53b88da491 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:58.496277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3633-21e7-41a4-936f-7f53b88da491 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:58.496424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be3633-21e7-41a4-936f-7f53b88da491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:58.514431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-18be3633-21e7-41a4-936f-7f53b88da491 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:58.515673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-18be3633-21e7-41a4-936f-7f53b88da491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:58.585870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:26:58.608948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f39aa-cbcb-4340-91ee-5091913d992b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:58.704804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:58.722824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05f39aa-cbcb-4340-91ee-5091913d992b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:58.867488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad762-194b-44b9-aad2-bbfcda0b1722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:58.868319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad762-194b-44b9-aad2-bbfcda0b1722 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:58.868602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad762-194b-44b9-aad2-bbfcda0b1722 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:58.868882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ad762-194b-44b9-aad2-bbfcda0b1722 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:58.880055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ad762-194b-44b9-aad2-bbfcda0b1722 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-978ad762-194b-44b9-aad2-bbfcda0b1722 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:26:58.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:26:58.888677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:26:58.889564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 25/49] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:26:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:26:58.895337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be3633-21e7-41a4-936f-7f53b88da491 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:58.962201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:58.996548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be3633-21e7-41a4-936f-7f53b88da491 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:59.032888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:59.033584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:59.033870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:59.034148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:59.034943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:26:59.035262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:59.036753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:59.046329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 25/50] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:26:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:59.052374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad762-194b-44b9-aad2-bbfcda0b1722 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:59.155013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ad762-194b-44b9-aad2-bbfcda0b1722 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:59.194952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4d1526-41d5-4f96-8499-ae5b77ddd6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:59.195868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1526-41d5-4f96-8499-ae5b77ddd6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:59.196217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1526-41d5-4f96-8499-ae5b77ddd6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:59.196585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4d1526-41d5-4f96-8499-ae5b77ddd6a7 None admin] PATH_INFO: `/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:59.197813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d1526-41d5-4f96-8499-ae5b77ddd6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4c5b191aab43d1b1bbd3832a632cc1)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:59.199404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4d1526-41d5-4f96-8499-ae5b77ddd6a7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:59.201222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 26/51] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:26:59 2022] GET /identity/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:26:59.206960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:59.246010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa727b46-aa85-41b7-b11d-b2fa1f5f053f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:59.246288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa727b46-aa85-41b7-b11d-b2fa1f5f053f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:59.246567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa727b46-aa85-41b7-b11d-b2fa1f5f053f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:59.247979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 27/52] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:26:59.252890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ff759-a982-4352-843c-4421492be362 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:59.253178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ff759-a982-4352-843c-4421492be362 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:59.253466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ff759-a982-4352-843c-4421492be362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:59.270465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-870ff759-a982-4352-843c-4421492be362 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:26:59.271702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-870ff759-a982-4352-843c-4421492be362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:26:59.279250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:59.308874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e294e-c9b7-4f04-b06c-b0d7fca87355 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:59.337572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:59.337712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 28/53] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:26:59.344616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a425f04-96cd-48c9-baf1-231b191c9d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:59.345449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425f04-96cd-48c9-baf1-231b191c9d75 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:59.345809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425f04-96cd-48c9-baf1-231b191c9d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:59.346019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a425f04-96cd-48c9-baf1-231b191c9d75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:59.347180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a425f04-96cd-48c9-baf1-231b191c9d75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:59.348703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a425f04-96cd-48c9-baf1-231b191c9d75 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:59.350366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 26/54] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:26:59.356174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ff759-a982-4352-843c-4421492be362 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:59.362802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a425f04-96cd-48c9-baf1-231b191c9d75 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:59.453576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ff759-a982-4352-843c-4421492be362 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:59.461739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a425f04-96cd-48c9-baf1-231b191c9d75 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:59.486926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37b94a-7052-4430-96f0-ad485703ecd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:59.487605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b94a-7052-4430-96f0-ad485703ecd1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:59.487917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b94a-7052-4430-96f0-ad485703ecd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:59.488200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b94a-7052-4430-96f0-ad485703ecd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:59.489049 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37b94a-7052-4430-96f0-ad485703ecd1 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.domain.id=default, user.id=3b4c5b191aab43d1b1bbd3832a632cc1) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:26:59.489583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37b94a-7052-4430-96f0-ad485703ecd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:59.490834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a37b94a-7052-4430-96f0-ad485703ecd1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:59.494247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a9d5-29cd-4d3e-9e87-76f2a14ca5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:59.495045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a9d5-29cd-4d3e-9e87-76f2a14ca5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:59.495329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a9d5-29cd-4d3e-9e87-76f2a14ca5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:59.495628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d94a9d5-29cd-4d3e-9e87-76f2a14ca5b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:59.496806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94a9d5-29cd-4d3e-9e87-76f2a14ca5b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:59.498304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d94a9d5-29cd-4d3e-9e87-76f2a14ca5b8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:59.499984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:26:59.500127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 29/56] 10.222.0.64 () {56 vars in 1322 bytes} [Tue Jul 12 13:26:59 2022] GET /identity/v3/role_assignments?user.id=3b4c5b191aab43d1b1bbd3832a632cc1&scope.domain.id=default&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:26:59.505771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a9d5-29cd-4d3e-9e87-76f2a14ca5b8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:26:59.576833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:26:59.615840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d94a9d5-29cd-4d3e-9e87-76f2a14ca5b8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:26:59.657327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a13b48a-a513-4fa0-b57e-8618a22000dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:26:59.658070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13b48a-a513-4fa0-b57e-8618a22000dd None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:26:59.658360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13b48a-a513-4fa0-b57e-8618a22000dd None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:26:59.658627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a13b48a-a513-4fa0-b57e-8618a22000dd None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:26:59.659351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13b48a-a513-4fa0-b57e-8618a22000dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:26:59.660887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a13b48a-a513-4fa0-b57e-8618a22000dd None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:26:59.687726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 28/57] 10.222.0.64 () {60 vars in 1140 bytes} [Tue Jul 12 13:26:59 2022] POST /identity/v3/projects => generated 298 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:01.722121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389ecd-e6ef-4d70-a71b-923161501551 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:01.722896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389ecd-e6ef-4d70-a71b-923161501551 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:01.723082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f389ecd-e6ef-4d70-a71b-923161501551 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:01.725307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 30/58] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:01.731780 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592106b-1533-4142-a70b-cc10a26f248f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:01.732443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592106b-1533-4142-a70b-cc10a26f248f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:01.732714 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592106b-1533-4142-a70b-cc10a26f248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:01.756044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1592106b-1533-4142-a70b-cc10a26f248f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:01.757277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1592106b-1533-4142-a70b-cc10a26f248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:01.828454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 29/59] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:01.857402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f389ecd-e6ef-4d70-a71b-923161501551 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:01.872469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:01.997546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f389ecd-e6ef-4d70-a71b-923161501551 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:02.032227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087157-c970-4e9e-aa96-f675c94948f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:02.033034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087157-c970-4e9e-aa96-f675c94948f2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:02.033325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087157-c970-4e9e-aa96-f675c94948f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:02.033592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087157-c970-4e9e-aa96-f675c94948f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:02.034933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a087157-c970-4e9e-aa96-f675c94948f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:02.036451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a087157-c970-4e9e-aa96-f675c94948f2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:02.038100 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 31/60] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:02.044779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592106b-1533-4142-a70b-cc10a26f248f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:02.106392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:02.158135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592106b-1533-4142-a70b-cc10a26f248f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:02.193322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ae004-41c7-467a-a103-ffcaf7ae6f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:02.193991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae004-41c7-467a-a103-ffcaf7ae6f14 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:02.194275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae004-41c7-467a-a103-ffcaf7ae6f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:02.194547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ae004-41c7-467a-a103-ffcaf7ae6f14 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:02.195271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ae004-41c7-467a-a103-ffcaf7ae6f14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:02.196774 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ae004-41c7-467a-a103-ffcaf7ae6f14 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:02.223168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 30/61] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:02 2022] POST /identity/v3/users => generated 275 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:05.322719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f545-da6e-4290-b50d-7ac7f65d9ccd None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.323274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f545-da6e-4290-b50d-7ac7f65d9ccd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.323274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773f545-da6e-4290-b50d-7ac7f65d9ccd None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.324963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 32/62] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:05.341602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceff203-2e78-427e-97a2-125f5625f3f8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.342160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceff203-2e78-427e-97a2-125f5625f3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.342258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceff203-2e78-427e-97a2-125f5625f3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.363947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-cceff203-2e78-427e-97a2-125f5625f3f8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:05.365501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cceff203-2e78-427e-97a2-125f5625f3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:05.415028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c5b3-51f6-4e3d-ae01-5f6162a47f86 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.415318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c5b3-51f6-4e3d-ae01-5f6162a47f86 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.416201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c5b3-51f6-4e3d-ae01-5f6162a47f86 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.417885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 33/63] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:05.423151 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baf92f-e56b-434d-a0cf-20f8c0259b2a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.423708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baf92f-e56b-434d-a0cf-20f8c0259b2a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.424219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56baf92f-e56b-434d-a0cf-20f8c0259b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.445571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 31/64] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:05.450154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-56baf92f-e56b-434d-a0cf-20f8c0259b2a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:05.460073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56baf92f-e56b-434d-a0cf-20f8c0259b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:05.481878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceff203-2e78-427e-97a2-125f5625f3f8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:05.517076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:05.588570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceff203-2e78-427e-97a2-125f5625f3f8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:05.626321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002980-df8a-4eac-afc6-76b360375bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:05.627400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002980-df8a-4eac-afc6-76b360375bdc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.627982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002980-df8a-4eac-afc6-76b360375bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.628409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5002980-df8a-4eac-afc6-76b360375bdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.639530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5002980-df8a-4eac-afc6-76b360375bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:05.647624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 34/65] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-b5002980-df8a-4eac-afc6-76b360375bdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:05.658644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:05.659764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:05.660834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:05.669044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 32/66] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:05.676749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baf92f-e56b-434d-a0cf-20f8c0259b2a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:05.682662 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002980-df8a-4eac-afc6-76b360375bdc None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:05.688717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:05.797175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56baf92f-e56b-434d-a0cf-20f8c0259b2a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:05.799314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:05.808457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5002980-df8a-4eac-afc6-76b360375bdc None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:05.838835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c792b29-bb5e-43ea-8277-30217d4f6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:05.839487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792b29-bb5e-43ea-8277-30217d4f6f9f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.839801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792b29-bb5e-43ea-8277-30217d4f6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.840194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c792b29-bb5e-43ea-8277-30217d4f6f9f None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.840863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c792b29-bb5e-43ea-8277-30217d4f6f9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:05.841171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c792b29-bb5e-43ea-8277-30217d4f6f9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:05.842677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c792b29-bb5e-43ea-8277-30217d4f6f9f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:05.845122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291dc83-bf46-4a38-bb01-5163179c78f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:05.846027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291dc83-bf46-4a38-bb01-5163179c78f7 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.846312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291dc83-bf46-4a38-bb01-5163179c78f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.846588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291dc83-bf46-4a38-bb01-5163179c78f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.855819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 35/67] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:05.855819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d4f3a-83a8-416a-9cee-9658277b19d5 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.855819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d4f3a-83a8-416a-9cee-9658277b19d5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.855819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d4f3a-83a8-416a-9cee-9658277b19d5 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.855819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 36/68] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:05.855819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7ea4-d31f-4c3f-ac00-b1fe1c8c49a3 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.856245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7ea4-d31f-4c3f-ac00-b1fe1c8c49a3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.856313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e7ea4-d31f-4c3f-ac00-b1fe1c8c49a3 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.857771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 37/69] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:05.860500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e7ea4-d31f-4c3f-ac00-b1fe1c8c49a3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:05.865386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291dc83-bf46-4a38-bb01-5163179c78f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-0291dc83-bf46-4a38-bb01-5163179c78f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:05.873133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:05.873958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:05.874736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 33/70] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:05.875978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17be1-dd77-428b-8d9a-c0a47162446e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.875978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17be1-dd77-428b-8d9a-c0a47162446e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.876143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a17be1-dd77-428b-8d9a-c0a47162446e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.892481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-45a17be1-dd77-428b-8d9a-c0a47162446e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:05.893686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-45a17be1-dd77-428b-8d9a-c0a47162446e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:05.943995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:05.972193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 34/71] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:05.972193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55122f61-218b-4db1-a5a3-380fb7429cb6 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:05.972193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55122f61-218b-4db1-a5a3-380fb7429cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:05.972193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55122f61-218b-4db1-a5a3-380fb7429cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:05.990782 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e7ea4-d31f-4c3f-ac00-b1fe1c8c49a3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:05.992116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-55122f61-218b-4db1-a5a3-380fb7429cb6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:05.993369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-55122f61-218b-4db1-a5a3-380fb7429cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:06.025792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee9367-c689-4adb-bd8b-58030858a957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.026692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee9367-c689-4adb-bd8b-58030858a957 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.027020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee9367-c689-4adb-bd8b-58030858a957 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.027300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee9367-c689-4adb-bd8b-58030858a957 None admin] PATH_INFO: `/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.028571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee9367-c689-4adb-bd8b-58030858a957 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4c5b191aab43d1b1bbd3832a632cc1)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:06.030052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cee9367-c689-4adb-bd8b-58030858a957 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:06.031756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 38/72] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:05 2022] GET /identity/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:06.032520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee9367-c689-4adb-bd8b-58030858a957 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.061973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 35/73] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:06.063532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e133-4101-4ec4-9b74-4545bd0d9e55 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.063843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e133-4101-4ec4-9b74-4545bd0d9e55 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.064129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e133-4101-4ec4-9b74-4545bd0d9e55 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.065409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 36/74] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:06.066099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6e133-4101-4ec4-9b74-4545bd0d9e55 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.085927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:06.135862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee9367-c689-4adb-bd8b-58030858a957 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.173321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.174009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.174299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.174579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.175342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:06.175688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:06.177098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:06.178423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:06.179621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6e133-4101-4ec4-9b74-4545bd0d9e55 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.186563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 39/75] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:06.187167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.214539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0ea24-60ba-442f-9610-75661898ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.215464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ea24-60ba-442f-9610-75661898ba39 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.215847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ea24-60ba-442f-9610-75661898ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.216133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0ea24-60ba-442f-9610-75661898ba39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.226744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0ea24-60ba-442f-9610-75661898ba39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-dfc0ea24-60ba-442f-9610-75661898ba39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:06.234438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:06.235289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:06.236086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 37/76] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:06.237179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15184f-0cc8-453b-bfce-7df6a78d8dc7 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.237269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15184f-0cc8-453b-bfce-7df6a78d8dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.237541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b15184f-0cc8-453b-bfce-7df6a78d8dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.254213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5b15184f-0cc8-453b-bfce-7df6a78d8dc7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:06.255426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5b15184f-0cc8-453b-bfce-7df6a78d8dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:06.288348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c35f5be-4896-4fd9-a0d2-a167981d824e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.322098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 38/77] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:06.322924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15184f-0cc8-453b-bfce-7df6a78d8dc7 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.325934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:06.334966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3afa9-53d0-4358-82fe-f935c6c62680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.335645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3afa9-53d0-4358-82fe-f935c6c62680 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.335955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3afa9-53d0-4358-82fe-f935c6c62680 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.336271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b3afa9-53d0-4358-82fe-f935c6c62680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.400959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:06.407664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3afa9-53d0-4358-82fe-f935c6c62680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:06.409167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b3afa9-53d0-4358-82fe-f935c6c62680 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:06.420914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b15184f-0cc8-453b-bfce-7df6a78d8dc7 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.454433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb607989-1338-4089-b4f4-889672335ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.455256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb607989-1338-4089-b4f4-889672335ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.455542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb607989-1338-4089-b4f4-889672335ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.455843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb607989-1338-4089-b4f4-889672335ce9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.466090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb607989-1338-4089-b4f4-889672335ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-cb607989-1338-4089-b4f4-889672335ce9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:06.474111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:06.474952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:06.475772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:06.476409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb607989-1338-4089-b4f4-889672335ce9 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.508558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 40/79] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:06.509413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3afa9-53d0-4358-82fe-f935c6c62680 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.543494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:06.581254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb607989-1338-4089-b4f4-889672335ce9 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.602667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:06.609252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b3afa9-53d0-4358-82fe-f935c6c62680 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.614840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8e83-85b0-494c-8dfb-e41648679a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.615768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8e83-85b0-494c-8dfb-e41648679a48 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.616051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8e83-85b0-494c-8dfb-e41648679a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.616326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e8e83-85b0-494c-8dfb-e41648679a48 None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.629540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8e83-85b0-494c-8dfb-e41648679a48 None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:06.631012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e8e83-85b0-494c-8dfb-e41648679a48 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:06.632738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 40/80] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:06.633496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8e83-85b0-494c-8dfb-e41648679a48 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.642940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.643644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.643935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.644213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.644976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:06.645289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:06.646675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:06.657959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 41/81] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:06.663781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.739133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e8e83-85b0-494c-8dfb-e41648679a48 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.760747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b2aa3-508a-49fb-9c90-3a40f0b12b38 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.761113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:06.772921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12a73-9520-402d-89f0-a00f7eecc157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.773735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12a73-9520-402d-89f0-a00f7eecc157 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.774019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12a73-9520-402d-89f0-a00f7eecc157 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.774297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc12a73-9520-402d-89f0-a00f7eecc157 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.775495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc12a73-9520-402d-89f0-a00f7eecc157 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:06.777005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc12a73-9520-402d-89f0-a00f7eecc157 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:06.778636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 41/82] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:06.779392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12a73-9520-402d-89f0-a00f7eecc157 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.795210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.795921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.796213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.796496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.797251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:06.797567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:06.798979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:06.806917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 42/83] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:06.807725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.829763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:06.876351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc12a73-9520-402d-89f0-a00f7eecc157 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.905412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95637357-95bb-40c3-a691-1e5b9a50d4e0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:06.908921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1f8d6-a1dc-42d2-a20b-f81977da4801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.909792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f8d6-a1dc-42d2-a20b-f81977da4801 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.910073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f8d6-a1dc-42d2-a20b-f81977da4801 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.910348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f8d6-a1dc-42d2-a20b-f81977da4801 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.911517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1f8d6-a1dc-42d2-a20b-f81977da4801 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:06.913046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1f8d6-a1dc-42d2-a20b-f81977da4801 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:06.914750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 42/84] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:06.915502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1f8d6-a1dc-42d2-a20b-f81977da4801 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:06.938395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba7100-5bb2-4f80-8b8f-18c1219c93f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:06.939078 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba7100-5bb2-4f80-8b8f-18c1219c93f4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:06.939365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba7100-5bb2-4f80-8b8f-18c1219c93f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:06.939668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba7100-5bb2-4f80-8b8f-18c1219c93f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:06.971784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:07.011438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba7100-5bb2-4f80-8b8f-18c1219c93f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:07.012987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba7100-5bb2-4f80-8b8f-18c1219c93f4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:07.017511 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1f8d6-a1dc-42d2-a20b-f81977da4801 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:07.037035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:07.053489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737fe3-4a68-4122-95ea-457dba6a4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:07.054394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737fe3-4a68-4122-95ea-457dba6a4e0f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:07.054687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737fe3-4a68-4122-95ea-457dba6a4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:07.054974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f737fe3-4a68-4122-95ea-457dba6a4e0f None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:07.056224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f737fe3-4a68-4122-95ea-457dba6a4e0f None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:07.057726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f737fe3-4a68-4122-95ea-457dba6a4e0f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:07.059718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 43/85] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:07.060529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737fe3-4a68-4122-95ea-457dba6a4e0f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:07.115667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 43/86] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:07.116715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba7100-5bb2-4f80-8b8f-18c1219c93f4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:07.160206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f737fe3-4a68-4122-95ea-457dba6a4e0f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:07.186365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:07.195825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39aeb2-2a79-4496-a73d-f0df4b77c4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:07.196521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39aeb2-2a79-4496-a73d-f0df4b77c4b3 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:07.196799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39aeb2-2a79-4496-a73d-f0df4b77c4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:07.197072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39aeb2-2a79-4496-a73d-f0df4b77c4b3 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:07.197793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39aeb2-2a79-4496-a73d-f0df4b77c4b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:07.199257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39aeb2-2a79-4496-a73d-f0df4b77c4b3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:07.215268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba7100-5bb2-4f80-8b8f-18c1219c93f4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:07.218825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 44/87] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:07 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:07.219732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39aeb2-2a79-4496-a73d-f0df4b77c4b3 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:07.237302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:07.255638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b757c8-3eb1-44d5-ad17-dbd4bbf6a9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:07.256558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b757c8-3eb1-44d5-ad17-dbd4bbf6a9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:07.256843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b757c8-3eb1-44d5-ad17-dbd4bbf6a9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:07.257118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b757c8-3eb1-44d5-ad17-dbd4bbf6a9b5 None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:07.258514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b757c8-3eb1-44d5-ad17-dbd4bbf6a9b5 None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:07.260069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b757c8-3eb1-44d5-ad17-dbd4bbf6a9b5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:07.266722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 44/88] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:07 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:07.266722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b757c8-3eb1-44d5-ad17-dbd4bbf6a9b5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:07.351739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39aeb2-2a79-4496-a73d-f0df4b77c4b3 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:07.386325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b757c8-3eb1-44d5-ad17-dbd4bbf6a9b5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:07.388833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:07.389915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:07.390204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:07.390482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:07.391341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=db1c690ced93499dab8ca839563bf7f0, user.id=3b4c5b191aab43d1b1bbd3832a632cc1) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:07.391677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:07.393703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:07.403173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 45/89] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:07 2022] GET /identity/v3/role_assignments?user.id=3b4c5b191aab43d1b1bbd3832a632cc1&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:07.409184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:07.437962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73cc63-e944-4cf3-a994-699deaeb54a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:07.438777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73cc63-e944-4cf3-a994-699deaeb54a3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:07.439166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73cc63-e944-4cf3-a994-699deaeb54a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:07.439547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73cc63-e944-4cf3-a994-699deaeb54a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:07.486018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:07.521011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:07.542781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73cc63-e944-4cf3-a994-699deaeb54a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:07.544451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73cc63-e944-4cf3-a994-699deaeb54a3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:07.580616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04a6ad-ef39-42c5-a36e-c5e5c4d8c6e8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:07.628395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7f08-f146-4a3c-a11b-d23b92e07e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:07.629346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7f08-f146-4a3c-a11b-d23b92e07e78 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:07.629623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7f08-f146-4a3c-a11b-d23b92e07e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:07.629906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7f08-f146-4a3c-a11b-d23b92e07e78 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:07.632387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe7f08-f146-4a3c-a11b-d23b92e07e78 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:07.633963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe7f08-f146-4a3c-a11b-d23b92e07e78 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:07.635714 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 46/90] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:07 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:07.636838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7f08-f146-4a3c-a11b-d23b92e07e78 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:07.667563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 45/91] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:07.668983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73cc63-e944-4cf3-a994-699deaeb54a3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:07.770408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:07.783050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73cc63-e944-4cf3-a994-699deaeb54a3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:07.820442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:07.821412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:07.821877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:07.822315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:07.823385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] RBAC: Adding query filter params (role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=db1c690ced93499dab8ca839563bf7f0, user.id=02db338388904076b43d2e14f2c60417) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:07.823941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:07.826161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:07.832594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 46/92] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:07 2022] GET /identity/v3/role_assignments?user.id=02db338388904076b43d2e14f2c60417&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:07.833970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:07.978754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a614a3b-8b5a-48aa-b67d-494c47bffcf0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:07.981788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7f08-f146-4a3c-a11b-d23b92e07e78 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:08.019007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:08.031370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9ce19-3321-4e0f-bd33-e5a0b7d22cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:08.032748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ce19-3321-4e0f-bd33-e5a0b7d22cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:08.033227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ce19-3321-4e0f-bd33-e5a0b7d22cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:08.033668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ce19-3321-4e0f-bd33-e5a0b7d22cd6 None admin] PATH_INFO: `/v3/projects/12d47bdb1a704259988e05fa61743112` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:08.035229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9ce19-3321-4e0f-bd33-e5a0b7d22cd6 None admin] RBAC: Authorizing `identity:get_project(project_id=12d47bdb1a704259988e05fa61743112)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:08.037160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9ce19-3321-4e0f-bd33-e5a0b7d22cd6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:08.039111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 47/93] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:07 2022] GET /identity/v3/projects/12d47bdb1a704259988e05fa61743112 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:08.045563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9ce19-3321-4e0f-bd33-e5a0b7d22cd6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:08.072869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd227c6-a800-4a40-bcdf-f41bba028d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:08.073388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd227c6-a800-4a40-bcdf-f41bba028d0b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:08.073678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd227c6-a800-4a40-bcdf-f41bba028d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:08.073962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd227c6-a800-4a40-bcdf-f41bba028d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:08.076963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:08.244563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd227c6-a800-4a40-bcdf-f41bba028d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:08.246083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd227c6-a800-4a40-bcdf-f41bba028d0b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:08.277719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9ce19-3321-4e0f-bd33-e5a0b7d22cd6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:08.362000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:08.362711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:08.362991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:08.363261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:08.364154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] RBAC: Adding query filter params (role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=12d47bdb1a704259988e05fa61743112, user.id=02db338388904076b43d2e14f2c60417) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:08.364473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:08.365960 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:08.372485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 48/94] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:08 2022] GET /identity/v3/role_assignments?user.id=02db338388904076b43d2e14f2c60417&scope.project.id=12d47bdb1a704259988e05fa61743112&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 259 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:08.448349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 47/95] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 812 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:08.454238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:08.604000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:08.610387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b409ff-7924-422b-a0eb-f51267d95bca None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:08.658924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad7c6a-d993-4c0c-9e3c-05afcc5b50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:08.659867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7c6a-d993-4c0c-9e3c-05afcc5b50e1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:08.660157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7c6a-d993-4c0c-9e3c-05afcc5b50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:08.660440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad7c6a-d993-4c0c-9e3c-05afcc5b50e1 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:08.662254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7c6a-d993-4c0c-9e3c-05afcc5b50e1 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:08.663855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad7c6a-d993-4c0c-9e3c-05afcc5b50e1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:08.665776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 49/96] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:08 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:08.672266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd227c6-a800-4a40-bcdf-f41bba028d0b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:08.716708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:08.863438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd227c6-a800-4a40-bcdf-f41bba028d0b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:08.924958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d7bc7-0c95-4ea0-8fd3-7f238f9bfba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:08.925560 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7bc7-0c95-4ea0-8fd3-7f238f9bfba1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:08.925847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7bc7-0c95-4ea0-8fd3-7f238f9bfba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:08.926127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d7bc7-0c95-4ea0-8fd3-7f238f9bfba1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:08.926980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d7bc7-0c95-4ea0-8fd3-7f238f9bfba1 None admin] RBAC: Adding query filter params (role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=db1c690ced93499dab8ca839563bf7f0, user.id=02db338388904076b43d2e14f2c60417) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:08.927300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d7bc7-0c95-4ea0-8fd3-7f238f9bfba1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:08.928811 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d7bc7-0c95-4ea0-8fd3-7f238f9bfba1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:08.936015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 48/97] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:08 2022] GET /identity/v3/role_assignments?user.id=02db338388904076b43d2e14f2c60417&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=f473c53d5223450d931d5e666473c86b => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:10.097404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3c86-1383-4916-88b6-61f5951d0f82 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.097927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3c86-1383-4916-88b6-61f5951d0f82 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.097999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea3c86-1383-4916-88b6-61f5951d0f82 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.099635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 50/98] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:10.105036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8bf3-733a-4e5a-a126-9bcab00a4505 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.105451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8bf3-733a-4e5a-a126-9bcab00a4505 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.105618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8bf3-733a-4e5a-a126-9bcab00a4505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.121585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff2dc-0d4e-4be0-8340-01f3926938b6 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.121892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff2dc-0d4e-4be0-8340-01f3926938b6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.122149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779ff2dc-0d4e-4be0-8340-01f3926938b6 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.123670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 51/99] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:10.128127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d8eb8bf3-733a-4e5a-a126-9bcab00a4505 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:10.128623 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd8f6-aad7-419c-b16d-a8efe2cab2a6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.128920 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd8f6-aad7-419c-b16d-a8efe2cab2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.129204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd8f6-aad7-419c-b16d-a8efe2cab2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.129366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d8eb8bf3-733a-4e5a-a126-9bcab00a4505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:10.148555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c65fd8f6-aad7-419c-b16d-a8efe2cab2a6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:10.149765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c65fd8f6-aad7-419c-b16d-a8efe2cab2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:10.301240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 49/100] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:10.333401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 52/101] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:10.334406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8bf3-733a-4e5a-a126-9bcab00a4505 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:10.353753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:10.376268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fd8f6-aad7-419c-b16d-a8efe2cab2a6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:10.495988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:10.519966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fd8f6-aad7-419c-b16d-a8efe2cab2a6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:10.524901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8bf3-733a-4e5a-a126-9bcab00a4505 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:10.578743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184182a-70ef-4cff-bfab-66e58b1c1e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:10.579554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184182a-70ef-4cff-bfab-66e58b1c1e47 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.579853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184182a-70ef-4cff-bfab-66e58b1c1e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.580127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184182a-70ef-4cff-bfab-66e58b1c1e47 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.589975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68bec-50f4-4ef0-8dde-15cd2ec3aacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:10.590779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68bec-50f4-4ef0-8dde-15cd2ec3aacb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.591059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68bec-50f4-4ef0-8dde-15cd2ec3aacb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.591333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b68bec-50f4-4ef0-8dde-15cd2ec3aacb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.593324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b68bec-50f4-4ef0-8dde-15cd2ec3aacb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:10.594762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b68bec-50f4-4ef0-8dde-15cd2ec3aacb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:10.596583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 53/102] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:10.601559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184182a-70ef-4cff-bfab-66e58b1c1e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-b184182a-70ef-4cff-bfab-66e58b1c1e47 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:10.609356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:10.610195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:10.610951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:10.611522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68bec-50f4-4ef0-8dde-15cd2ec3aacb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:10.615169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 50/103] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:10.625021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184182a-70ef-4cff-bfab-66e58b1c1e47 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:10.766416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:10.792569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b68bec-50f4-4ef0-8dde-15cd2ec3aacb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:10.827345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62995389-01a8-4f54-bf3c-5c31fb47e483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:10.828312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995389-01a8-4f54-bf3c-5c31fb47e483 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.828733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995389-01a8-4f54-bf3c-5c31fb47e483 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.829148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62995389-01a8-4f54-bf3c-5c31fb47e483 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.830002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995389-01a8-4f54-bf3c-5c31fb47e483 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:10.831586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62995389-01a8-4f54-bf3c-5c31fb47e483 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:10.834385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184182a-70ef-4cff-bfab-66e58b1c1e47 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:10.877800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 54/104] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:27:10 2022] POST /identity/v3/projects => generated 302 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:10.879489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7231422-455a-4852-beea-28d307e4901c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.879986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7231422-455a-4852-beea-28d307e4901c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.880408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7231422-455a-4852-beea-28d307e4901c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.882400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 55/105] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:10.889727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:10.889972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e90b-3831-4f9d-b277-e9ed55ffcd6d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.890315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e90b-3831-4f9d-b277-e9ed55ffcd6d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.890598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968e90b-3831-4f9d-b277-e9ed55ffcd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.891095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:10.891523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:10.891956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:10.892892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:10.893427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:10.895005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:10.910812 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 51/106] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:10.911423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:10.918260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:10.936879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2968e90b-3831-4f9d-b277-e9ed55ffcd6d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:10.938285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2968e90b-3831-4f9d-b277-e9ed55ffcd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:11.065752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 56/107] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:11.067208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719529a4-a672-44c5-8dad-9342e9e76b5d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.067504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719529a4-a672-44c5-8dad-9342e9e76b5d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.067820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719529a4-a672-44c5-8dad-9342e9e76b5d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.069105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 57/108] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:11.076126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c801a1-0a2a-4941-a710-de5d91a03e23 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.076651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c801a1-0a2a-4941-a710-de5d91a03e23 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.077170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c801a1-0a2a-4941-a710-de5d91a03e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.112830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-37c801a1-0a2a-4941-a710-de5d91a03e23 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:11.114059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-37c801a1-0a2a-4941-a710-de5d91a03e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:11.134427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611ac77-5a7d-44c5-8832-58878cfecab5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:11.176802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:11.182885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce13f5-0d82-4408-8bd9-f819cfcd5b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:11.184038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce13f5-0d82-4408-8bd9-f819cfcd5b3e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.184875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce13f5-0d82-4408-8bd9-f819cfcd5b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.185277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce13f5-0d82-4408-8bd9-f819cfcd5b3e None admin] PATH_INFO: `/v3/users/d1b1e2a4240340d293ec1be8f7453907` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.200768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce13f5-0d82-4408-8bd9-f819cfcd5b3e None admin] RBAC: Authorizing `identity:get_user(user_id=d1b1e2a4240340d293ec1be8f7453907)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:11.202487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce13f5-0d82-4408-8bd9-f819cfcd5b3e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:11.204743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 52/109] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:10 2022] GET /identity/v3/users/d1b1e2a4240340d293ec1be8f7453907 => generated 289 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:11.205571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce13f5-0d82-4408-8bd9-f819cfcd5b3e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:11.217185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 58/110] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:11.218145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c801a1-0a2a-4941-a710-de5d91a03e23 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:11.295873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:11.326058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce13f5-0d82-4408-8bd9-f819cfcd5b3e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:11.344494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c801a1-0a2a-4941-a710-de5d91a03e23 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:11.366896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ef87-5f7d-4d5f-9901-9369033ec9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:11.367740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ef87-5f7d-4d5f-9901-9369033ec9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.368032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ef87-5f7d-4d5f-9901-9369033ec9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.368309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1ef87-5f7d-4d5f-9901-9369033ec9d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.379341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de1ef87-5f7d-4d5f-9901-9369033ec9d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-7de1ef87-5f7d-4d5f-9901-9369033ec9d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:11.387268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:11.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 53/111] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:11.389519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ef87-5f7d-4d5f-9901-9369033ec9d4 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:11.403863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21bbb-7d0c-413b-bd66-35f1ac229d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:11.404635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21bbb-7d0c-413b-bd66-35f1ac229d00 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.404917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21bbb-7d0c-413b-bd66-35f1ac229d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.405198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af21bbb-7d0c-413b-bd66-35f1ac229d00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.442397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:11.498870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1ef87-5f7d-4d5f-9901-9369033ec9d4 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:11.534775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63157864-c56a-47c8-987c-129c21db2e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:11.535718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63157864-c56a-47c8-987c-129c21db2e52 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.536071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63157864-c56a-47c8-987c-129c21db2e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.536356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63157864-c56a-47c8-987c-129c21db2e52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.536461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af21bbb-7d0c-413b-bd66-35f1ac229d00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:11.537931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af21bbb-7d0c-413b-bd66-35f1ac229d00 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:11.547748 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63157864-c56a-47c8-987c-129c21db2e52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-63157864-c56a-47c8-987c-129c21db2e52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:11.555825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:11.556679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:11.557870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 54/112] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:11.558522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63157864-c56a-47c8-987c-129c21db2e52 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:11.619683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:11.670629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 59/113] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:11.675060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63157864-c56a-47c8-987c-129c21db2e52 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:11.676055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21bbb-7d0c-413b-bd66-35f1ac229d00 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:11.686026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:11.712806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a5c90-970c-4896-9a85-122ceefc9894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:11.713732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5c90-970c-4896-9a85-122ceefc9894 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.714162 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5c90-970c-4896-9a85-122ceefc9894 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.714587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a5c90-970c-4896-9a85-122ceefc9894 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.715504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a5c90-970c-4896-9a85-122ceefc9894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:11.715988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a5c90-970c-4896-9a85-122ceefc9894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:11.717597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a5c90-970c-4896-9a85-122ceefc9894 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:11.726523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 55/114] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:11.728034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412307-dd52-4eca-97f4-6662b98ed1a8 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.728481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412307-dd52-4eca-97f4-6662b98ed1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.728963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4412307-dd52-4eca-97f4-6662b98ed1a8 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.730615 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 56/115] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:11.731485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4412307-dd52-4eca-97f4-6662b98ed1a8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:11.790641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af21bbb-7d0c-413b-bd66-35f1ac229d00 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:11.830153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:11.830842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.831245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.831530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.832351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:11.832666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:11.834109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:11.849543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 60/116] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:11.849848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4412307-dd52-4eca-97f4-6662b98ed1a8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:11.850380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:11.883849 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:11.889064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba08613-5d1a-4ef5-9f29-0c6883a15d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:11.890556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08613-5d1a-4ef5-9f29-0c6883a15d00 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.891036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08613-5d1a-4ef5-9f29-0c6883a15d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.891519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba08613-5d1a-4ef5-9f29-0c6883a15d00 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.892958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba08613-5d1a-4ef5-9f29-0c6883a15d00 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:11.894843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba08613-5d1a-4ef5-9f29-0c6883a15d00 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:11.896856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 57/117] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:11 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:11.898310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc057a-ad76-476f-a27d-aadd334a03b8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:11.898848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc057a-ad76-476f-a27d-aadd334a03b8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:11.899371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc057a-ad76-476f-a27d-aadd334a03b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:11.917441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-65dc057a-ad76-476f-a27d-aadd334a03b8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:11.919046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-65dc057a-ad76-476f-a27d-aadd334a03b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:11.950436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:11.970067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae2f3e-8cdf-4819-b5a3-46ae86fb484a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:11.993607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 58/118] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:11.994465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc057a-ad76-476f-a27d-aadd334a03b8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.014744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fde27-4109-41c0-be13-bbef4a548af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.015669 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fde27-4109-41c0-be13-bbef4a548af6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.016477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fde27-4109-41c0-be13-bbef4a548af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.016765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0fde27-4109-41c0-be13-bbef4a548af6 None admin] PATH_INFO: `/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.018203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fde27-4109-41c0-be13-bbef4a548af6 None admin] RBAC: Authorizing `identity:get_user(user_id=3b4c5b191aab43d1b1bbd3832a632cc1)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:12.019838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0fde27-4109-41c0-be13-bbef4a548af6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:12.021504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 61/119] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:11 2022] GET /identity/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1 => generated 247 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:12.022268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fde27-4109-41c0-be13-bbef4a548af6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.116982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc057a-ad76-476f-a27d-aadd334a03b8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.120890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:12.132060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0fde27-4109-41c0-be13-bbef4a548af6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.151855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83a7cf-f677-4137-8dd1-b262554042d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.152798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83a7cf-f677-4137-8dd1-b262554042d7 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.153086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83a7cf-f677-4137-8dd1-b262554042d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.153390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83a7cf-f677-4137-8dd1-b262554042d7 None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.154691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83a7cf-f677-4137-8dd1-b262554042d7 None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:12.156319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83a7cf-f677-4137-8dd1-b262554042d7 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:12.162768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 59/120] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:11 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:12.162768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374bc5-6950-4c7f-a2bc-0ffce0ab6568 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.162768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374bc5-6950-4c7f-a2bc-0ffce0ab6568 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.162768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374bc5-6950-4c7f-a2bc-0ffce0ab6568 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.162768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 60/121] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:12.162768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98374bc5-6950-4c7f-a2bc-0ffce0ab6568 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.175756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.176363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.176652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.176934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.177779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] RBAC: Adding query filter params (role.id=c61c0210f997401eb1ea6dc7bbdcfe25, scope.project.id=db1c690ced93499dab8ca839563bf7f0, user.id=d1b1e2a4240340d293ec1be8f7453907) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:12.178099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:12.179556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:12.195631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 62/122] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:12 2022] GET /identity/v3/role_assignments?user.id=d1b1e2a4240340d293ec1be8f7453907&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=c61c0210f997401eb1ea6dc7bbdcfe25 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:12.195631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.213015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:12.300095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98374bc5-6950-4c7f-a2bc-0ffce0ab6568 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.343936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ec309-1254-41b0-bf0c-af7f3030f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.343936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ec309-1254-41b0-bf0c-af7f3030f606 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.344248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bea9c-eed0-443a-a30b-41d440be6858 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.344327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ec309-1254-41b0-bf0c-af7f3030f606 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.344666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ec309-1254-41b0-bf0c-af7f3030f606 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.357869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ec309-1254-41b0-bf0c-af7f3030f606 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ed5ec309-1254-41b0-bf0c-af7f3030f606 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:12.367909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:12.368787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:12.369551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:12.377000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 61/123] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:12.378363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ec309-1254-41b0-bf0c-af7f3030f606 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.380696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e13e12-3147-4f8a-8969-7a3f316708aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.381588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e13e12-3147-4f8a-8969-7a3f316708aa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.381870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e13e12-3147-4f8a-8969-7a3f316708aa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.382148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e13e12-3147-4f8a-8969-7a3f316708aa None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.384409 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e13e12-3147-4f8a-8969-7a3f316708aa None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:12.385880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e13e12-3147-4f8a-8969-7a3f316708aa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:12.387925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 63/124] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:12 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:12.388953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a72a-d832-4f95-80f7-79ea6d0a276d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.389246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a72a-d832-4f95-80f7-79ea6d0a276d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.389528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a2a72a-d832-4f95-80f7-79ea6d0a276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.409663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-38a2a72a-d832-4f95-80f7-79ea6d0a276d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:12.411166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-38a2a72a-d832-4f95-80f7-79ea6d0a276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:12.437774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:12.488368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:12.495828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ec309-1254-41b0-bf0c-af7f3030f606 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.502947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 64/125] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:12.504581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2a72a-d832-4f95-80f7-79ea6d0a276d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.532376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a0a2-2737-40bb-8b02-2e21c4976057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.533424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a0a2-2737-40bb-8b02-2e21c4976057 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.533798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a0a2-2737-40bb-8b02-2e21c4976057 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.534167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d0a0a2-2737-40bb-8b02-2e21c4976057 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.535834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0a0a2-2737-40bb-8b02-2e21c4976057 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:12.537416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d0a0a2-2737-40bb-8b02-2e21c4976057 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:12.544225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 62/126] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:12 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:12.544225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a0a2-2737-40bb-8b02-2e21c4976057 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.631929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a2a72a-d832-4f95-80f7-79ea6d0a276d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.663538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d0a0a2-2737-40bb-8b02-2e21c4976057 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.673556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.674589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.675094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.675575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.676639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:12.677234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:12.678948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:12.688687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 65/127] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:12.689803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.698682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d2ea2-1cf6-419c-bcc4-ae4f0aecde05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.699593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d2ea2-1cf6-419c-bcc4-ae4f0aecde05 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.700220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d2ea2-1cf6-419c-bcc4-ae4f0aecde05 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.700220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d2ea2-1cf6-419c-bcc4-ae4f0aecde05 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0/users/3b4c5b191aab43d1b1bbd3832a632cc1/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.702458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d2ea2-1cf6-419c-bcc4-ae4f0aecde05 None admin] RBAC: Authorizing `identity:create_grant(project_id=db1c690ced93499dab8ca839563bf7f0, user_id=3b4c5b191aab43d1b1bbd3832a632cc1, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:12.703657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d2ea2-1cf6-419c-bcc4-ae4f0aecde05 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:12.712715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:12.721468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 63/128] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:12 2022] PUT /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0/users/3b4c5b191aab43d1b1bbd3832a632cc1/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:12.722821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d2ea2-1cf6-419c-bcc4-ae4f0aecde05 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.756761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:12.816256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1334f6c-a662-4cfd-8450-21231ce2604b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.861872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d2ea2-1cf6-419c-bcc4-ae4f0aecde05 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:12.863856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944b212-53af-47cb-8054-7f605b1460b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.864873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944b212-53af-47cb-8054-7f605b1460b2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.865325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944b212-53af-47cb-8054-7f605b1460b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.865763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944b212-53af-47cb-8054-7f605b1460b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.891299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944b212-53af-47cb-8054-7f605b1460b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9944b212-53af-47cb-8054-7f605b1460b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:12.910663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:12.911804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:12.912768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:12.914921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 66/129] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:12.915952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944b212-53af-47cb-8054-7f605b1460b2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:12.942016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771759a0-7169-4e63-a7fa-c72df0101e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:12.943228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771759a0-7169-4e63-a7fa-c72df0101e02 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:12.943685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771759a0-7169-4e63-a7fa-c72df0101e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:12.944115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771759a0-7169-4e63-a7fa-c72df0101e02 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0/users/02db338388904076b43d2e14f2c60417/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:12.948065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771759a0-7169-4e63-a7fa-c72df0101e02 None admin] RBAC: Authorizing `identity:create_grant(project_id=db1c690ced93499dab8ca839563bf7f0, user_id=02db338388904076b43d2e14f2c60417, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:12.949764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771759a0-7169-4e63-a7fa-c72df0101e02 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:12.969188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 64/130] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:12 2022] PUT /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0/users/02db338388904076b43d2e14f2c60417/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:12.975924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771759a0-7169-4e63-a7fa-c72df0101e02 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:13.073870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.103495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944b212-53af-47cb-8054-7f605b1460b2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:13.142986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be54b1-ef24-4c6f-95d2-3fc18ea43d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:13.144132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be54b1-ef24-4c6f-95d2-3fc18ea43d59 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.144420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be54b1-ef24-4c6f-95d2-3fc18ea43d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.144702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be54b1-ef24-4c6f-95d2-3fc18ea43d59 None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.146317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be54b1-ef24-4c6f-95d2-3fc18ea43d59 None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:13.147913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be54b1-ef24-4c6f-95d2-3fc18ea43d59 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:13.149886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 67/131] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:12 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:13.156204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be54b1-ef24-4c6f-95d2-3fc18ea43d59 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:13.185345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.206197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771759a0-7169-4e63-a7fa-c72df0101e02 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:13.243919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:13.244612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.244927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.245276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.246151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:13.246471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:13.247992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:13.257257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 65/132] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:13.262711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:13.317359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be54b1-ef24-4c6f-95d2-3fc18ea43d59 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:13.373235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc650b50-e9a3-4293-b950-7a19f2452e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:13.374073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121969d-2018-4457-8d65-6e679cf465f5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:13.374245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650b50-e9a3-4293-b950-7a19f2452e6e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.374397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650b50-e9a3-4293-b950-7a19f2452e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.374655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc650b50-e9a3-4293-b950-7a19f2452e6e None admin] PATH_INFO: `/v3/projects/12d47bdb1a704259988e05fa61743112` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.380380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc650b50-e9a3-4293-b950-7a19f2452e6e None admin] RBAC: Authorizing `identity:get_project(project_id=12d47bdb1a704259988e05fa61743112)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:13.381880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc650b50-e9a3-4293-b950-7a19f2452e6e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:13.383836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 68/133] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:13 2022] GET /identity/v3/projects/12d47bdb1a704259988e05fa61743112 => generated 312 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:13.392508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc650b50-e9a3-4293-b950-7a19f2452e6e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:13.410416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a79ba-76da-4d04-8fba-61a167da6646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:13.411468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a79ba-76da-4d04-8fba-61a167da6646 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.411866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a79ba-76da-4d04-8fba-61a167da6646 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.412146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a79ba-76da-4d04-8fba-61a167da6646 None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.413489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a79ba-76da-4d04-8fba-61a167da6646 None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:13.414094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.416354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a79ba-76da-4d04-8fba-61a167da6646 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:13.419143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 66/134] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:13 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:13.424459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a79ba-76da-4d04-8fba-61a167da6646 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:13.452035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.530833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a79ba-76da-4d04-8fba-61a167da6646 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:13.566701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc650b50-e9a3-4293-b950-7a19f2452e6e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:13.599674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e579e-45a5-4daf-bba3-f5e9cc7b87fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:13.601035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e579e-45a5-4daf-bba3-f5e9cc7b87fa None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.601512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e579e-45a5-4daf-bba3-f5e9cc7b87fa None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.601984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02e579e-45a5-4daf-bba3-f5e9cc7b87fa None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.603444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e579e-45a5-4daf-bba3-f5e9cc7b87fa None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:13.605175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02e579e-45a5-4daf-bba3-f5e9cc7b87fa None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:13.611644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 67/135] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:13 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:13.612719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e579e-45a5-4daf-bba3-f5e9cc7b87fa None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:13.640875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768d161-0e89-4b55-b7b2-2ae9d8fbba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:13.641892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d161-0e89-4b55-b7b2-2ae9d8fbba7e None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.642176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d161-0e89-4b55-b7b2-2ae9d8fbba7e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.642452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768d161-0e89-4b55-b7b2-2ae9d8fbba7e None admin] PATH_INFO: `/v3/projects/12d47bdb1a704259988e05fa61743112/users/02db338388904076b43d2e14f2c60417/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.644528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768d161-0e89-4b55-b7b2-2ae9d8fbba7e None admin] RBAC: Authorizing `identity:create_grant(project_id=12d47bdb1a704259988e05fa61743112, user_id=02db338388904076b43d2e14f2c60417, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:13.646027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768d161-0e89-4b55-b7b2-2ae9d8fbba7e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:13.689345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 69/136] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:13 2022] PUT /identity/v3/projects/12d47bdb1a704259988e05fa61743112/users/02db338388904076b43d2e14f2c60417/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:27:13.689345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62365-653a-4805-9993-c98e8bed2b5b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.689345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62365-653a-4805-9993-c98e8bed2b5b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.689345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c62365-653a-4805-9993-c98e8bed2b5b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.693539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 70/137] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:13 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:13.695339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5014a-708a-4f57-aaa8-6a637fc36f38 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.695884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5014a-708a-4f57-aaa8-6a637fc36f38 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.696184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5014a-708a-4f57-aaa8-6a637fc36f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.725781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c6a5014a-708a-4f57-aaa8-6a637fc36f38 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:13.727107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c6a5014a-708a-4f57-aaa8-6a637fc36f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:13.771400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.806319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02e579e-45a5-4daf-bba3-f5e9cc7b87fa None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:13.850432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 71/138] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:13.876476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ab7e6-8fc3-4b60-9685-86fbf8b4bd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:13.877415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ab7e6-8fc3-4b60-9685-86fbf8b4bd66 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:13.877701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ab7e6-8fc3-4b60-9685-86fbf8b4bd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:13.877938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5014a-708a-4f57-aaa8-6a637fc36f38 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:13.878032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ab7e6-8fc3-4b60-9685-86fbf8b4bd66 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0/users/02db338388904076b43d2e14f2c60417/roles/f473c53d5223450d931d5e666473c86b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:13.880484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:13.882074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ab7e6-8fc3-4b60-9685-86fbf8b4bd66 None admin] RBAC: Authorizing `identity:create_grant(project_id=db1c690ced93499dab8ca839563bf7f0, user_id=02db338388904076b43d2e14f2c60417, role_id=f473c53d5223450d931d5e666473c86b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:13.885389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ab7e6-8fc3-4b60-9685-86fbf8b4bd66 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:13.904115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 68/139] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:13 2022] PUT /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0/users/02db338388904076b43d2e14f2c60417/roles/f473c53d5223450d931d5e666473c86b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:14.049654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5014a-708a-4f57-aaa8-6a637fc36f38 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:14.088968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728ed660-f1a6-40e5-b170-7423ccf12415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:14.089792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ed660-f1a6-40e5-b170-7423ccf12415 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:14.090077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ed660-f1a6-40e5-b170-7423ccf12415 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:14.090354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728ed660-f1a6-40e5-b170-7423ccf12415 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:14.091643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ed660-f1a6-40e5-b170-7423ccf12415 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:14.093139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728ed660-f1a6-40e5-b170-7423ccf12415 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:14.094949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 72/140] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:14.100602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ab7e6-8fc3-4b60-9685-86fbf8b4bd66 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:14.225254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ab7e6-8fc3-4b60-9685-86fbf8b4bd66 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:14.263909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e283252-8749-44a8-99b5-fd26f178e23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:14.264646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283252-8749-44a8-99b5-fd26f178e23b None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:14.264931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283252-8749-44a8-99b5-fd26f178e23b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:14.265217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e283252-8749-44a8-99b5-fd26f178e23b None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:14.265972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e283252-8749-44a8-99b5-fd26f178e23b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:14.267430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e283252-8749-44a8-99b5-fd26f178e23b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:14.291788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:14.298372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 69/141] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:14 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:15.037354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b301a-7783-4646-aaf4-2f954b21829a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:15.037862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b301a-7783-4646-aaf4-2f954b21829a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:15.037862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b301a-7783-4646-aaf4-2f954b21829a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:15.039513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 73/142] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:15.045433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bc5f-a1b8-4c2b-8083-c6e52cbaa06a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:15.045727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bc5f-a1b8-4c2b-8083-c6e52cbaa06a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:15.046010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7bc5f-a1b8-4c2b-8083-c6e52cbaa06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:15.072722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-34d7bc5f-a1b8-4c2b-8083-c6e52cbaa06a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:15.074081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-34d7bc5f-a1b8-4c2b-8083-c6e52cbaa06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:15.150354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 70/143] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:15.174383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b301a-7783-4646-aaf4-2f954b21829a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:15.259035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:15.293917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214b301a-7783-4646-aaf4-2f954b21829a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:15.330017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c2437-733b-4622-bfb4-adecf1a99352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:15.330837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c2437-733b-4622-bfb4-adecf1a99352 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:15.331125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c2437-733b-4622-bfb4-adecf1a99352 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:15.331403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c2437-733b-4622-bfb4-adecf1a99352 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:15.348601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c2437-733b-4622-bfb4-adecf1a99352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ce9c2437-733b-4622-bfb4-adecf1a99352 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:15.356580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:15.357473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:15.358242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 74/144] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:15.363943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7bc5f-a1b8-4c2b-8083-c6e52cbaa06a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:15.474169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7bc5f-a1b8-4c2b-8083-c6e52cbaa06a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:15.509605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:15.520668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b0f698-1418-452c-8a1f-f37d1eb499de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:15.521365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f698-1418-452c-8a1f-f37d1eb499de None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:15.521652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f698-1418-452c-8a1f-f37d1eb499de None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:15.521932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b0f698-1418-452c-8a1f-f37d1eb499de None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:15.522700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0f698-1418-452c-8a1f-f37d1eb499de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:15.523011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0f698-1418-452c-8a1f-f37d1eb499de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:15.524558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b0f698-1418-452c-8a1f-f37d1eb499de None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:15.533775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 71/145] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:15.539365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c2437-733b-4622-bfb4-adecf1a99352 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:15.666682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd19c6-1297-48d7-91e3-04d8f6d42b9f None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:15.666991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd19c6-1297-48d7-91e3-04d8f6d42b9f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:15.667237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd19c6-1297-48d7-91e3-04d8f6d42b9f None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:15.668895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 72/146] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:15.676066 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909f26-c6a5-4a87-8336-559d419ffa50 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:15.676356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909f26-c6a5-4a87-8336-559d419ffa50 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:15.676833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93909f26-c6a5-4a87-8336-559d419ffa50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:15.716212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c2437-733b-4622-bfb4-adecf1a99352 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:15.718501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-93909f26-c6a5-4a87-8336-559d419ffa50 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:15.722533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-93909f26-c6a5-4a87-8336-559d419ffa50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:15.776169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:15.788928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02c0c4-21b7-4825-9bd6-738e53bee63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:15.790177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02c0c4-21b7-4825-9bd6-738e53bee63f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:15.791044 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02c0c4-21b7-4825-9bd6-738e53bee63f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:15.791538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a02c0c4-21b7-4825-9bd6-738e53bee63f None admin] PATH_INFO: `/v3/users/d1b1e2a4240340d293ec1be8f7453907` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:15.793325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02c0c4-21b7-4825-9bd6-738e53bee63f None admin] RBAC: Authorizing `identity:get_user(user_id=d1b1e2a4240340d293ec1be8f7453907)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:15.795107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a02c0c4-21b7-4825-9bd6-738e53bee63f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:15.797207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 75/147] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:15 2022] GET /identity/v3/users/d1b1e2a4240340d293ec1be8f7453907 => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:15.803879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02c0c4-21b7-4825-9bd6-738e53bee63f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:15.881777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 73/148] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:15.916602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93909f26-c6a5-4a87-8336-559d419ffa50 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:15.961183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a02c0c4-21b7-4825-9bd6-738e53bee63f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:16.031078 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f292da3-9b80-479d-9231-022590c95cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:16.032978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292da3-9b80-479d-9231-022590c95cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.034908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292da3-9b80-479d-9231-022590c95cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.040002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f292da3-9b80-479d-9231-022590c95cd4 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.041386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f292da3-9b80-479d-9231-022590c95cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:16.042881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f292da3-9b80-479d-9231-022590c95cd4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:16.044864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 76/149] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:15 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:16.050718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f292da3-9b80-479d-9231-022590c95cd4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:16.084456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93909f26-c6a5-4a87-8336-559d419ffa50 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:16.114723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:16.135179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48defb-89f3-49ce-9cc2-b010faa1aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:16.136509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48defb-89f3-49ce-9cc2-b010faa1aead None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.137059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48defb-89f3-49ce-9cc2-b010faa1aead None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.137561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48defb-89f3-49ce-9cc2-b010faa1aead None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.153629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48defb-89f3-49ce-9cc2-b010faa1aead None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-4b48defb-89f3-49ce-9cc2-b010faa1aead None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:16.161894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:16.162764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:16.163594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:16.166072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 74/150] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:16.171786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec2943-d174-4b9b-9b1e-b3dbc1ec8753 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.172308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec2943-d174-4b9b-9b1e-b3dbc1ec8753 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.172775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec2943-d174-4b9b-9b1e-b3dbc1ec8753 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.174424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 75/151] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:16.175350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec2943-d174-4b9b-9b1e-b3dbc1ec8753 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:16.187457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:16.234712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f292da3-9b80-479d-9231-022590c95cd4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:16.287970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eae501-3f04-4e91-ae58-50eb863353ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:16.287970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae501-3f04-4e91-ae58-50eb863353ed None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.287970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae501-3f04-4e91-ae58-50eb863353ed None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.287970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eae501-3f04-4e91-ae58-50eb863353ed None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0/users/d1b1e2a4240340d293ec1be8f7453907/roles/c61c0210f997401eb1ea6dc7bbdcfe25` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.288506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae501-3f04-4e91-ae58-50eb863353ed None admin] RBAC: Authorizing `identity:create_grant(project_id=db1c690ced93499dab8ca839563bf7f0, user_id=d1b1e2a4240340d293ec1be8f7453907, role_id=c61c0210f997401eb1ea6dc7bbdcfe25)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:16.288506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eae501-3f04-4e91-ae58-50eb863353ed None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:16.313497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 77/152] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:16 2022] PUT /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0/users/d1b1e2a4240340d293ec1be8f7453907/roles/c61c0210f997401eb1ea6dc7bbdcfe25 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:27:16.314778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3a9a-28bb-4aad-bf6c-7d4a4d0c2da4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.315069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3a9a-28bb-4aad-bf6c-7d4a4d0c2da4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.315344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac3a9a-28bb-4aad-bf6c-7d4a4d0c2da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.324839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec2943-d174-4b9b-9b1e-b3dbc1ec8753 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:16.347628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a4ac3a9a-28bb-4aad-bf6c-7d4a4d0c2da4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:16.347858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a4ac3a9a-28bb-4aad-bf6c-7d4a4d0c2da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:16.380533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:16.382027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.382479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.382919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.383933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:16.384433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:16.386257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:16.402316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 76/153] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:16.407002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:16.448601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 78/154] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:16.473433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3a9a-28bb-4aad-bf6c-7d4a4d0c2da4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:16.482336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:16.529798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:16.566205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133cb69e-723e-48e6-ba5b-9b637c4c3c6f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:16.621919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df822e3b-b584-44a9-9b81-f72d7ece6e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:16.623183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822e3b-b584-44a9-9b81-f72d7ece6e7a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.623696 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822e3b-b584-44a9-9b81-f72d7ece6e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.624138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df822e3b-b584-44a9-9b81-f72d7ece6e7a None admin] PATH_INFO: `/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.625723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df822e3b-b584-44a9-9b81-f72d7ece6e7a None admin] RBAC: Authorizing `identity:get_user(user_id=3b4c5b191aab43d1b1bbd3832a632cc1)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:16.627414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df822e3b-b584-44a9-9b81-f72d7ece6e7a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:16.633576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac3a9a-28bb-4aad-bf6c-7d4a4d0c2da4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:16.633876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 77/155] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:16 2022] GET /identity/v3/users/3b4c5b191aab43d1b1bbd3832a632cc1 => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:16.634909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df822e3b-b584-44a9-9b81-f72d7ece6e7a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:16.760481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bd89-cf16-4041-8ea6-b3fa6ee0d37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:16.761331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bd89-cf16-4041-8ea6-b3fa6ee0d37f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.761620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bd89-cf16-4041-8ea6-b3fa6ee0d37f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.761892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94bd89-cf16-4041-8ea6-b3fa6ee0d37f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.765571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df822e3b-b584-44a9-9b81-f72d7ece6e7a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:16.789105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94bd89-cf16-4041-8ea6-b3fa6ee0d37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:16.791970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-5b94bd89-cf16-4041-8ea6-b3fa6ee0d37f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:16.805339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:16.806395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:16.807231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 79/156] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:16.815127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bd89-cf16-4041-8ea6-b3fa6ee0d37f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:16.815868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d951ca-f147-422f-a664-7b7c647534a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:16.816562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d951ca-f147-422f-a664-7b7c647534a4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:16.816843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d951ca-f147-422f-a664-7b7c647534a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:16.817120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d951ca-f147-422f-a664-7b7c647534a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:16.914891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d951ca-f147-422f-a664-7b7c647534a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:16.921383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d951ca-f147-422f-a664-7b7c647534a4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:16.971022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94bd89-cf16-4041-8ea6-b3fa6ee0d37f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:17.000270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:17.041141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:17.041854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.042017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.042293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.043070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:17.043380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:17.048934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:17.057973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 80/157] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:17.062157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 78/158] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:17.068604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d951ca-f147-422f-a664-7b7c647534a4 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:17.068727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:17.095970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:17.236948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f2d835-9a7e-4b13-8b86-72a61d2f3e0a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:17.317876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584b7b5-9d8f-4a8a-bd7a-aff4538932ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:17.319099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584b7b5-9d8f-4a8a-bd7a-aff4538932ca None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.320210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584b7b5-9d8f-4a8a-bd7a-aff4538932ca None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.320838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584b7b5-9d8f-4a8a-bd7a-aff4538932ca None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.322880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d951ca-f147-422f-a664-7b7c647534a4 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:17.324342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584b7b5-9d8f-4a8a-bd7a-aff4538932ca None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:17.326107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584b7b5-9d8f-4a8a-bd7a-aff4538932ca None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:17.333687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 81/159] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:17 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:17.358917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584b7b5-9d8f-4a8a-bd7a-aff4538932ca None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:17.388374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22601d0a-b0fe-4ec3-8a47-50c3b7fdc52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:17.389958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22601d0a-b0fe-4ec3-8a47-50c3b7fdc52b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.391645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22601d0a-b0fe-4ec3-8a47-50c3b7fdc52b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.392111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22601d0a-b0fe-4ec3-8a47-50c3b7fdc52b None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.393951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22601d0a-b0fe-4ec3-8a47-50c3b7fdc52b None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:17.396268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22601d0a-b0fe-4ec3-8a47-50c3b7fdc52b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:17.400026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 79/160] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:17 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:17.404049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22601d0a-b0fe-4ec3-8a47-50c3b7fdc52b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:17.440258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:17.502524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584b7b5-9d8f-4a8a-bd7a-aff4538932ca None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:17.544366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:17.570370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83e14-eb2b-4339-a42c-25d042b1d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:17.570997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83e14-eb2b-4339-a42c-25d042b1d781 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.571276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83e14-eb2b-4339-a42c-25d042b1d781 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.571550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e83e14-eb2b-4339-a42c-25d042b1d781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.579984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22601d0a-b0fe-4ec3-8a47-50c3b7fdc52b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:17.632608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0e7552-48e6-4db5-a97a-85abd18b81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:17.633331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7552-48e6-4db5-a97a-85abd18b81ec None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.633640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7552-48e6-4db5-a97a-85abd18b81ec None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.633922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0e7552-48e6-4db5-a97a-85abd18b81ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.634775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e7552-48e6-4db5-a97a-85abd18b81ec None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=db1c690ced93499dab8ca839563bf7f0, user.id=3b4c5b191aab43d1b1bbd3832a632cc1) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:17.635091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e7552-48e6-4db5-a97a-85abd18b81ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:17.636578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0e7552-48e6-4db5-a97a-85abd18b81ec None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:17.643486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 80/161] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:17 2022] GET /identity/v3/role_assignments?user.id=3b4c5b191aab43d1b1bbd3832a632cc1&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:17.681298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478dd5-e443-4458-a2fc-f0da1547274a None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.681606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478dd5-e443-4458-a2fc-f0da1547274a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.681867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3478dd5-e443-4458-a2fc-f0da1547274a None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.683445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 81/162] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:17.693137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9041-d971-427f-af0d-5d06a1856386 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.693435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9041-d971-427f-af0d-5d06a1856386 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.693689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d9041-d971-427f-af0d-5d06a1856386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.703526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e83e14-eb2b-4339-a42c-25d042b1d781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:17.705091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e83e14-eb2b-4339-a42c-25d042b1d781 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:17.732803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-da3d9041-d971-427f-af0d-5d06a1856386 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:17.734037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-da3d9041-d971-427f-af0d-5d06a1856386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:17.797020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:17.838332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 82/163] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:17.859727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d706b-cb2d-4373-bcda-856234fb8612 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.860056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d706b-cb2d-4373-bcda-856234fb8612 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.860291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d706b-cb2d-4373-bcda-856234fb8612 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.861680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 83/164] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:17.868839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889f347-0613-4331-bd8a-905495c9abdd None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:17.869140 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889f347-0613-4331-bd8a-905495c9abdd None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:17.869409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889f347-0613-4331-bd8a-905495c9abdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:17.902132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5889f347-0613-4331-bd8a-905495c9abdd None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:17.903366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5889f347-0613-4331-bd8a-905495c9abdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:17.916476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 82/165] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:17.917423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83e14-eb2b-4339-a42c-25d042b1d781 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:18.053936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 84/166] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:18.054887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889f347-0613-4331-bd8a-905495c9abdd None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:18.059897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:18.090032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e83e14-eb2b-4339-a42c-25d042b1d781 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:18.161421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f7dec-f707-42b2-8d06-6f9f136c9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:18.162809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f7dec-f707-42b2-8d06-6f9f136c9da3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:18.163092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f7dec-f707-42b2-8d06-6f9f136c9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:18.163370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f7dec-f707-42b2-8d06-6f9f136c9da3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:18.183590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f7dec-f707-42b2-8d06-6f9f136c9da3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-da9f7dec-f707-42b2-8d06-6f9f136c9da3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:18.197404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:18.198345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:18.199840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 83/167] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:18.200873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f7dec-f707-42b2-8d06-6f9f136c9da3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:18.215991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:18.261314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889f347-0613-4331-bd8a-905495c9abdd None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:18.336979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b08d-2d9d-4780-8d08-1b02c46678e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:18.337871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b08d-2d9d-4780-8d08-1b02c46678e6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:18.338158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b08d-2d9d-4780-8d08-1b02c46678e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:18.338431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343b08d-2d9d-4780-8d08-1b02c46678e6 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:18.341174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343b08d-2d9d-4780-8d08-1b02c46678e6 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:18.342796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343b08d-2d9d-4780-8d08-1b02c46678e6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:18.344894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 85/168] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:18 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:18.345680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b08d-2d9d-4780-8d08-1b02c46678e6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:18.411272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f7dec-f707-42b2-8d06-6f9f136c9da3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:18.485615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918573-a13d-4fb6-aac2-e831fcfdabdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:18.486794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918573-a13d-4fb6-aac2-e831fcfdabdf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:18.487270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918573-a13d-4fb6-aac2-e831fcfdabdf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:18.487933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97918573-a13d-4fb6-aac2-e831fcfdabdf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:18.489537 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:18.520799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97918573-a13d-4fb6-aac2-e831fcfdabdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-97918573-a13d-4fb6-aac2-e831fcfdabdf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:18.540413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:18.541378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:18.542169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 84/169] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:18.542809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918573-a13d-4fb6-aac2-e831fcfdabdf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:18.559666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343b08d-2d9d-4780-8d08-1b02c46678e6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:18.627804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:18.628453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:18.628741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:18.629010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:18.629939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] RBAC: Adding query filter params (name=member) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:18.630254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:18.631685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:18.652487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 86/170] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:18.653409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:18.730409 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:18.796900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b9cef-3aec-4f13-9e6f-fea1cea9ee19 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:18.823322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97918573-a13d-4fb6-aac2-e831fcfdabdf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:18.828722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:18.843387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:18.844335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:18.844625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:18.844896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:18.845664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:18.845972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:18.847361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:18.868322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 87/171] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:18.873542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:18.898612 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:18.899206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:18.899486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:18.899786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:18.900635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] RBAC: Adding query filter params (role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=db1c690ced93499dab8ca839563bf7f0, user.id=02db338388904076b43d2e14f2c60417) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:18.900951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:18.902416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:18.920436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 85/172] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:18 2022] GET /identity/v3/role_assignments?user.id=02db338388904076b43d2e14f2c60417&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 608 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:18.921265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:19.134654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad224b6-ecda-4985-9b22-2df8eeb75204 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:19.175722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90402c-473e-495a-a5e7-1737d42a4527 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:19.182595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2507bc-5592-4277-aa06-cd37a2b972fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:19.183796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2507bc-5592-4277-aa06-cd37a2b972fd None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.184602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2507bc-5592-4277-aa06-cd37a2b972fd None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.185152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2507bc-5592-4277-aa06-cd37a2b972fd None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.188399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2507bc-5592-4277-aa06-cd37a2b972fd None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:19.190098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2507bc-5592-4277-aa06-cd37a2b972fd None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:19.192336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 88/173] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:18 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:19.193878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889cd0-3746-4011-880c-06201c61614a None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.194363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889cd0-3746-4011-880c-06201c61614a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.194827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf889cd0-3746-4011-880c-06201c61614a None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.201274 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 89/174] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:19 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:19.202268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf889cd0-3746-4011-880c-06201c61614a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:19.227008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:19.240654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e529c-584a-455d-b5d5-dd7a4ec361ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:19.242330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e529c-584a-455d-b5d5-dd7a4ec361ee None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.243304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e529c-584a-455d-b5d5-dd7a4ec361ee None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.245155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e529c-584a-455d-b5d5-dd7a4ec361ee None admin] PATH_INFO: `/v3/users/02db338388904076b43d2e14f2c60417` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.248272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e529c-584a-455d-b5d5-dd7a4ec361ee None admin] RBAC: Authorizing `identity:get_user(user_id=02db338388904076b43d2e14f2c60417)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:19.254636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e529c-584a-455d-b5d5-dd7a4ec361ee None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:19.257040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 86/175] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:18 2022] GET /identity/v3/users/02db338388904076b43d2e14f2c60417 => generated 275 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:19.258461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a362-f2a8-4d36-87d8-18c9792beff1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.260012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a362-f2a8-4d36-87d8-18c9792beff1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.260306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a362-f2a8-4d36-87d8-18c9792beff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.284144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ea13a362-f2a8-4d36-87d8-18c9792beff1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:19.285347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ea13a362-f2a8-4d36-87d8-18c9792beff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:19.310921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:19.339918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf889cd0-3746-4011-880c-06201c61614a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:19.369170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 87/176] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:19.370053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a362-f2a8-4d36-87d8-18c9792beff1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:19.401268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3b9b-c684-4277-809c-f2c1f16897b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:19.401944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3b9b-c684-4277-809c-f2c1f16897b6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.402361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3b9b-c684-4277-809c-f2c1f16897b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.402642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3b9b-c684-4277-809c-f2c1f16897b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.502002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc3b9b-c684-4277-809c-f2c1f16897b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:19.503383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc3b9b-c684-4277-809c-f2c1f16897b6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:19.522403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a362-f2a8-4d36-87d8-18c9792beff1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:19.568095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:19.571689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:19.578825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae04eea-ba83-4ce3-9c51-333a03a3773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:19.579771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04eea-ba83-4ce3-9c51-333a03a3773d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.580169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04eea-ba83-4ce3-9c51-333a03a3773d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.580511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae04eea-ba83-4ce3-9c51-333a03a3773d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.608945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 90/177] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:19.609806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3b9b-c684-4277-809c-f2c1f16897b6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:19.668646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04eea-ba83-4ce3-9c51-333a03a3773d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:19.670184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae04eea-ba83-4ce3-9c51-333a03a3773d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:19.715830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3b9b-c684-4277-809c-f2c1f16897b6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:19.750865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafd62d-b0d9-4632-ba68-62e32ac7e061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:19.751698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd62d-b0d9-4632-ba68-62e32ac7e061 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.751980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd62d-b0d9-4632-ba68-62e32ac7e061 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.752302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafd62d-b0d9-4632-ba68-62e32ac7e061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.763553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafd62d-b0d9-4632-ba68-62e32ac7e061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:19.773932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 88/178] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:19.773932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf80a-f529-43d2-a2fe-94b2c2c963ef None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.773932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf80a-f529-43d2-a2fe-94b2c2c963ef None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-8bafd62d-b0d9-4632-ba68-62e32ac7e061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:19.774223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:19.775017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:19.776822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:19.777412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988bf80a-f529-43d2-a2fe-94b2c2c963ef None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.777487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 91/179] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:19.777559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 89/180] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:19.778094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafd62d-b0d9-4632-ba68-62e32ac7e061 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:19.778266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bf6d-9ec2-43ad-8288-1019d0010d75 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.778577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bf6d-9ec2-43ad-8288-1019d0010d75 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.778883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54bf6d-9ec2-43ad-8288-1019d0010d75 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.780388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 90/181] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:19.781135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54bf6d-9ec2-43ad-8288-1019d0010d75 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:19.808583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:19.812560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:19.883302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54bf6d-9ec2-43ad-8288-1019d0010d75 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:19.888522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafd62d-b0d9-4632-ba68-62e32ac7e061 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:19.917580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c8aaf-803e-4ffa-a9dd-1a364d23324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:19.918451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8aaf-803e-4ffa-a9dd-1a364d23324c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.918735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8aaf-803e-4ffa-a9dd-1a364d23324c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.919010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c8aaf-803e-4ffa-a9dd-1a364d23324c None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.920242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8aaf-803e-4ffa-a9dd-1a364d23324c None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:19.921700 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c8aaf-803e-4ffa-a9dd-1a364d23324c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:19.922349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e45e-8b20-495c-a870-8c1daac44f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:19.923205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e45e-8b20-495c-a870-8c1daac44f8a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.923395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 91/182] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:19 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:19.923803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e45e-8b20-495c-a870-8c1daac44f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.924080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403e45e-8b20-495c-a870-8c1daac44f8a None admin] PATH_INFO: `/v3/projects/12d47bdb1a704259988e05fa61743112` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.924575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05ffd-75f4-4f27-a106-bd62f3d70d4a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:19.924838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05ffd-75f4-4f27-a106-bd62f3d70d4a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:19.925112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e05ffd-75f4-4f27-a106-bd62f3d70d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:19.928915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403e45e-8b20-495c-a870-8c1daac44f8a None admin] RBAC: Authorizing `identity:get_project(project_id=12d47bdb1a704259988e05fa61743112)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:19.930354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403e45e-8b20-495c-a870-8c1daac44f8a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:19.937027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 92/183] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:19 2022] GET /identity/v3/projects/12d47bdb1a704259988e05fa61743112 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:19.937027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e45e-8b20-495c-a870-8c1daac44f8a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:19.943942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-94e05ffd-75f4-4f27-a106-bd62f3d70d4a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:19.945118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-94e05ffd-75f4-4f27-a106-bd62f3d70d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:20.008614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 92/184] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:20.009918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d313-7084-42da-8c12-1bf252c19ca3 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.010209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d313-7084-42da-8c12-1bf252c19ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.010474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441d313-7084-42da-8c12-1bf252c19ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.027711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c441d313-7084-42da-8c12-1bf252c19ca3 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:20.028948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:20.029159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c441d313-7084-42da-8c12-1bf252c19ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:20.039281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403e45e-8b20-495c-a870-8c1daac44f8a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.054516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:20.074151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4bd60c-35c3-4a0b-b942-4377ba746281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.074830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bd60c-35c3-4a0b-b942-4377ba746281 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.075113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bd60c-35c3-4a0b-b942-4377ba746281 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.075389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4bd60c-35c3-4a0b-b942-4377ba746281 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.076211 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bd60c-35c3-4a0b-b942-4377ba746281 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:20.076522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bd60c-35c3-4a0b-b942-4377ba746281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:20.077904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4bd60c-35c3-4a0b-b942-4377ba746281 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:20.085916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 93/185] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:20.087219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9999c1d-e911-46bd-82f8-98baa7ad2d75 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.087508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9999c1d-e911-46bd-82f8-98baa7ad2d75 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.087807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9999c1d-e911-46bd-82f8-98baa7ad2d75 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.089034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 94/186] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:20.092385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9999c1d-e911-46bd-82f8-98baa7ad2d75 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.104010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 93/187] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:20.104849 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441d313-7084-42da-8c12-1bf252c19ca3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.195818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9999c1d-e911-46bd-82f8-98baa7ad2d75 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.204343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441d313-7084-42da-8c12-1bf252c19ca3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.228749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.229404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.229680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.229948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.230773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] RBAC: Adding query filter params (role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=db1c690ced93499dab8ca839563bf7f0, user.id=02db338388904076b43d2e14f2c60417) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:20.231080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:20.232616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:20.237204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.237859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.238139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.251149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 95/188] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/role_assignments?user.id=02db338388904076b43d2e14f2c60417&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=f473c53d5223450d931d5e666473c86b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:20.251404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.251487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.251558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] RBAC: Adding query filter params (role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=12d47bdb1a704259988e05fa61743112, user.id=02db338388904076b43d2e14f2c60417) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:20.251558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:20.251558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:20.251558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 94/189] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/role_assignments?user.id=02db338388904076b43d2e14f2c60417&scope.project.id=12d47bdb1a704259988e05fa61743112&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:20.251558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.278347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:20.291241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:20.377868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e00788-8c21-4ec5-b83f-cdfb07edab88 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.402689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ee317b-190a-4dc1-a4a3-232971c33183 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.419833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36c7ed-1ff8-434e-8cff-5185ccf2dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.420934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36c7ed-1ff8-434e-8cff-5185ccf2dec0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.421312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36c7ed-1ff8-434e-8cff-5185ccf2dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.421717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36c7ed-1ff8-434e-8cff-5185ccf2dec0 None admin] PATH_INFO: `/v3/users/f7c32427a83b43029671ddf89b73412b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.443461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36c7ed-1ff8-434e-8cff-5185ccf2dec0 None admin] RBAC: Authorizing `identity:get_user(user_id=f7c32427a83b43029671ddf89b73412b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:20.445322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36c7ed-1ff8-434e-8cff-5185ccf2dec0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:20.447232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 95/190] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/users/f7c32427a83b43029671ddf89b73412b => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:20.448496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b57881-4e3e-4d11-98d4-d4cc9e5170dd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.448780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b57881-4e3e-4d11-98d4-d4cc9e5170dd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.449051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b57881-4e3e-4d11-98d4-d4cc9e5170dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.450969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267f1fd-a87e-4102-ab42-aa8312451ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.452045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267f1fd-a87e-4102-ab42-aa8312451ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.452529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267f1fd-a87e-4102-ab42-aa8312451ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.452948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267f1fd-a87e-4102-ab42-aa8312451ca0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.455225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267f1fd-a87e-4102-ab42-aa8312451ca0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:20.456737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2267f1fd-a87e-4102-ab42-aa8312451ca0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:20.458686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 96/191] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:20.459462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267f1fd-a87e-4102-ab42-aa8312451ca0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.467944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-98b57881-4e3e-4d11-98d4-d4cc9e5170dd None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:20.469819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-98b57881-4e3e-4d11-98d4-d4cc9e5170dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:20.546700 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 96/192] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:20.547507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b57881-4e3e-4d11-98d4-d4cc9e5170dd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.557259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:20.559095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:20.578694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267f1fd-a87e-4102-ab42-aa8312451ca0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.611620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff87f6-605c-49ee-b8c7-29f0e3c8a578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.612471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff87f6-605c-49ee-b8c7-29f0e3c8a578 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.612757 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff87f6-605c-49ee-b8c7-29f0e3c8a578 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.613011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff87f6-605c-49ee-b8c7-29f0e3c8a578 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.623554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff87f6-605c-49ee-b8c7-29f0e3c8a578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-86ff87f6-605c-49ee-b8c7-29f0e3c8a578 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:20.631822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:20.632816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:20.633845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 97/193] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:20.634841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff87f6-605c-49ee-b8c7-29f0e3c8a578 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.655147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b57881-4e3e-4d11-98d4-d4cc9e5170dd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.690994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def6399-f286-4f1b-8d5f-eb102756ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.691662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def6399-f286-4f1b-8d5f-eb102756ba97 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.691956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def6399-f286-4f1b-8d5f-eb102756ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.692253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def6399-f286-4f1b-8d5f-eb102756ba97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.737841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff87f6-605c-49ee-b8c7-29f0e3c8a578 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.758728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def6399-f286-4f1b-8d5f-eb102756ba97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:20.760344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def6399-f286-4f1b-8d5f-eb102756ba97 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:20.769962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:20.771306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03eb6-e652-44db-a886-b54a600143f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.772104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03eb6-e652-44db-a886-b54a600143f0 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.772592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03eb6-e652-44db-a886-b54a600143f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.774097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f03eb6-e652-44db-a886-b54a600143f0 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.774097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f03eb6-e652-44db-a886-b54a600143f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:20.775225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f03eb6-e652-44db-a886-b54a600143f0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:20.790571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:20.795477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 98/194] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:20 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:20.796340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03eb6-e652-44db-a886-b54a600143f0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.883524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 97/195] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:20.884430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def6399-f286-4f1b-8d5f-eb102756ba97 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.910610 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f03eb6-e652-44db-a886-b54a600143f0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:20.947491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7997a-623a-4d4b-953e-986a3ff06695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:20.948368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7997a-623a-4d4b-953e-986a3ff06695 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:20.948647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7997a-623a-4d4b-953e-986a3ff06695 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:20.948917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d7997a-623a-4d4b-953e-986a3ff06695 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:20.963554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d7997a-623a-4d4b-953e-986a3ff06695 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-c5d7997a-623a-4d4b-953e-986a3ff06695 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:20.971420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:20.972431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:20.973216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 99/196] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:20.973863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7997a-623a-4d4b-953e-986a3ff06695 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:20.998488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def6399-f286-4f1b-8d5f-eb102756ba97 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:21.008392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:21.037892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:21.038807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:21.039085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:21.040036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:21.040588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:21.040958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:21.042379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:21.047449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:21.053223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 98/197] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:21.054148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:21.098933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d7997a-623a-4d4b-953e-986a3ff06695 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:21.137322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47209d3-043e-441a-867d-86389acc1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:21.138309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47209d3-043e-441a-867d-86389acc1608 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:21.138595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47209d3-043e-441a-867d-86389acc1608 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:21.138867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47209d3-043e-441a-867d-86389acc1608 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:21.140189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47209d3-043e-441a-867d-86389acc1608 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:21.142987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47209d3-043e-441a-867d-86389acc1608 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:21.145103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 100/198] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:20 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:21.145956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47209d3-043e-441a-867d-86389acc1608 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:21.177269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ce85e9-9c92-43a5-9dc5-1cfd2fdbcea6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:21.221385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:21.222137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:21.222441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:21.222720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:21.223688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:21.224002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:21.226199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:21.236284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 99/199] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:21.237544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:21.263540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47209d3-043e-441a-867d-86389acc1608 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:21.278059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:21.304096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36769c28-441d-4ff9-97ca-2f0c3252dc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:21.305326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36769c28-441d-4ff9-97ca-2f0c3252dc22 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:21.305823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36769c28-441d-4ff9-97ca-2f0c3252dc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:21.306660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36769c28-441d-4ff9-97ca-2f0c3252dc22 None admin] PATH_INFO: `/v3/users/f7c32427a83b43029671ddf89b73412b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:21.307991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:21.312327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36769c28-441d-4ff9-97ca-2f0c3252dc22 None admin] RBAC: Authorizing `identity:get_user(user_id=f7c32427a83b43029671ddf89b73412b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:21.314930 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36769c28-441d-4ff9-97ca-2f0c3252dc22 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:21.318112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 101/200] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:21 2022] GET /identity/v3/users/f7c32427a83b43029671ddf89b73412b => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:21.319276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36769c28-441d-4ff9-97ca-2f0c3252dc22 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:21.360370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5279af2-8843-4cdb-a3c3-a9e2be48d8fc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:21.395876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:21.396462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:21.396744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:21.397059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:21.397910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc, user.id=f7c32427a83b43029671ddf89b73412b) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:21.398222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:21.399807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:21.411775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 100/201] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:21 2022] GET /identity/v3/role_assignments?user.id=f7c32427a83b43029671ddf89b73412b&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:21.412761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:21.438360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36769c28-441d-4ff9-97ca-2f0c3252dc22 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:21.484784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bacd61-4976-4379-986c-320e3010dd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:21.486094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bacd61-4976-4379-986c-320e3010dd45 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:21.486568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bacd61-4976-4379-986c-320e3010dd45 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:21.487026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bacd61-4976-4379-986c-320e3010dd45 None admin] PATH_INFO: `/v3/users/d1b1e2a4240340d293ec1be8f7453907` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:21.488625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bacd61-4976-4379-986c-320e3010dd45 None admin] RBAC: Authorizing `identity:get_user(user_id=d1b1e2a4240340d293ec1be8f7453907)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:21.490345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bacd61-4976-4379-986c-320e3010dd45 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:21.492172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 102/202] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:21 2022] GET /identity/v3/users/d1b1e2a4240340d293ec1be8f7453907 => generated 289 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:21.503659 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bacd61-4976-4379-986c-320e3010dd45 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:21.564948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:21.582204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:21.589441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106b559-5bfb-40dd-b0a5-fb00a280a917 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:21.607643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bacd61-4976-4379-986c-320e3010dd45 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:21.644230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174dce8-718c-4887-96d8-330ba5fcc82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:21.644907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174dce8-718c-4887-96d8-330ba5fcc82f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:21.645186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174dce8-718c-4887-96d8-330ba5fcc82f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:21.645456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174dce8-718c-4887-96d8-330ba5fcc82f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:21.695439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e49a3-5977-41be-8f28-83c74f0785c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:21.696518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e49a3-5977-41be-8f28-83c74f0785c5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:21.697059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e49a3-5977-41be-8f28-83c74f0785c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:21.697708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e49a3-5977-41be-8f28-83c74f0785c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:21.725249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174dce8-718c-4887-96d8-330ba5fcc82f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:21.726748 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174dce8-718c-4887-96d8-330ba5fcc82f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:21.799659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e49a3-5977-41be-8f28-83c74f0785c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:21.801180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e49a3-5977-41be-8f28-83c74f0785c5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:21.820306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:21.884692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 103/203] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:21.892331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174dce8-718c-4887-96d8-330ba5fcc82f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:21.961599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:21.974809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 101/204] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:21.979927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e49a3-5977-41be-8f28-83c74f0785c5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:22.009765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174dce8-718c-4887-96d8-330ba5fcc82f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:22.074246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7879-4544-413b-a076-dabe77d9b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:22.075129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7879-4544-413b-a076-dabe77d9b41f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:22.075404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7879-4544-413b-a076-dabe77d9b41f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:22.076434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7879-4544-413b-a076-dabe77d9b41f None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:22.077484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e7879-4544-413b-a076-dabe77d9b41f None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:22.078553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e7879-4544-413b-a076-dabe77d9b41f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:22.092349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 104/205] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:21 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:22.092349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7879-4544-413b-a076-dabe77d9b41f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:22.123191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:22.139675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e49a3-5977-41be-8f28-83c74f0785c5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:22.196350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7879-4544-413b-a076-dabe77d9b41f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:22.204899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb161fc2-caff-4c54-8bfc-26d551d9a4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:22.205794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb161fc2-caff-4c54-8bfc-26d551d9a4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:22.206077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb161fc2-caff-4c54-8bfc-26d551d9a4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:22.206354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb161fc2-caff-4c54-8bfc-26d551d9a4d8 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:22.212422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb161fc2-caff-4c54-8bfc-26d551d9a4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:22.213860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb161fc2-caff-4c54-8bfc-26d551d9a4d8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:22.215951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 102/206] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:21 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:22.221709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb161fc2-caff-4c54-8bfc-26d551d9a4d8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:22.232081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d5d80-2f64-4188-8174-372260b41e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:22.232809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5d80-2f64-4188-8174-372260b41e7c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:22.233088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5d80-2f64-4188-8174-372260b41e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:22.233358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d5d80-2f64-4188-8174-372260b41e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:22.234243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d5d80-2f64-4188-8174-372260b41e7c None admin] RBAC: Adding query filter params (role.id=c61c0210f997401eb1ea6dc7bbdcfe25, scope.project.id=db1c690ced93499dab8ca839563bf7f0, user.id=d1b1e2a4240340d293ec1be8f7453907) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:22.234555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d5d80-2f64-4188-8174-372260b41e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:22.236029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d5d80-2f64-4188-8174-372260b41e7c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:22.242488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 105/207] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:22 2022] GET /identity/v3/role_assignments?user.id=d1b1e2a4240340d293ec1be8f7453907&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=c61c0210f997401eb1ea6dc7bbdcfe25 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:22.328805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:22.387788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb161fc2-caff-4c54-8bfc-26d551d9a4d8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:22.437108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbca389-9fce-4926-8e5c-9e149ad67700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:22.438200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbca389-9fce-4926-8e5c-9e149ad67700 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:22.438682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbca389-9fce-4926-8e5c-9e149ad67700 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:22.439160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbca389-9fce-4926-8e5c-9e149ad67700 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:22.440225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbca389-9fce-4926-8e5c-9e149ad67700 None admin] RBAC: Adding query filter params (role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc, user.id=f7c32427a83b43029671ddf89b73412b) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:22.440753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbca389-9fce-4926-8e5c-9e149ad67700 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:22.442403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbca389-9fce-4926-8e5c-9e149ad67700 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:22.451917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 103/208] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:22 2022] GET /identity/v3/role_assignments?user.id=f7c32427a83b43029671ddf89b73412b&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=f473c53d5223450d931d5e666473c86b => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:23.080851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e6d2-29a6-4c9c-93d4-7a91d2f21b8f None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.081380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e6d2-29a6-4c9c-93d4-7a91d2f21b8f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.081380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5e6d2-29a6-4c9c-93d4-7a91d2f21b8f None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.083007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 106/209] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:23.088397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21fb64-e24d-4717-89f3-4ba71d523d1e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.088686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21fb64-e24d-4717-89f3-4ba71d523d1e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.088962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21fb64-e24d-4717-89f3-4ba71d523d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.106415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4a21fb64-e24d-4717-89f3-4ba71d523d1e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:23.107722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4a21fb64-e24d-4717-89f3-4ba71d523d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:23.176403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 104/210] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:23.200238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e6d2-29a6-4c9c-93d4-7a91d2f21b8f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:23.289363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ee4b3-89f1-4980-a4f1-c98ef5bd0787 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.290033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ee4b3-89f1-4980-a4f1-c98ef5bd0787 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.290150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ee4b3-89f1-4980-a4f1-c98ef5bd0787 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.291687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 105/211] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:23.296994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e418546-31e6-458a-a12b-45b6730460f6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.297508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e418546-31e6-458a-a12b-45b6730460f6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.298007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e418546-31e6-458a-a12b-45b6730460f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.301302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:23.307921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5e6d2-29a6-4c9c-93d4-7a91d2f21b8f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:23.322689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7e418546-31e6-458a-a12b-45b6730460f6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:23.324289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7e418546-31e6-458a-a12b-45b6730460f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:23.354409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f6262-47a3-4df3-a8b5-6bff69d0cb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:23.355907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6262-47a3-4df3-a8b5-6bff69d0cb61 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.356721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6262-47a3-4df3-a8b5-6bff69d0cb61 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.357680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f6262-47a3-4df3-a8b5-6bff69d0cb61 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.371376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f6262-47a3-4df3-a8b5-6bff69d0cb61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-595f6262-47a3-4df3-a8b5-6bff69d0cb61 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:23.382870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:23.384015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:23.385032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:23.387496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:23.388836 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 107/212] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:23.395005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f6262-47a3-4df3-a8b5-6bff69d0cb61 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:23.405370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 106/213] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:23.431506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e418546-31e6-458a-a12b-45b6730460f6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:23.506909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f6262-47a3-4df3-a8b5-6bff69d0cb61 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:23.535201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e418546-31e6-458a-a12b-45b6730460f6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:23.543534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:23.544526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.544814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.545094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.545868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:23.546180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:23.547738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:23.557252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 108/214] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:23.563192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:23.578567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed4cb7-01c7-4f62-997a-248f8045cb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:23.579923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4cb7-01c7-4f62-997a-248f8045cb1a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.580484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4cb7-01c7-4f62-997a-248f8045cb1a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.581023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed4cb7-01c7-4f62-997a-248f8045cb1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.582450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed4cb7-01c7-4f62-997a-248f8045cb1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:23.583983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:23.585255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed4cb7-01c7-4f62-997a-248f8045cb1a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:23.587134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 107/215] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:23.593473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed4cb7-01c7-4f62-997a-248f8045cb1a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:23.652121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:23.675290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a8267-0a4c-4c10-95f6-6d8da97062cb None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:23.701164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed4cb7-01c7-4f62-997a-248f8045cb1a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:23.711690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b91c6b-ff64-4822-a39a-80f967c2a951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:23.712591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b91c6b-ff64-4822-a39a-80f967c2a951 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.712875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b91c6b-ff64-4822-a39a-80f967c2a951 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.713153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b91c6b-ff64-4822-a39a-80f967c2a951 None admin] PATH_INFO: `/v3/users/12bf876ebf134a14ba1ff3cc7c3f7d9a` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.727941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b91c6b-ff64-4822-a39a-80f967c2a951 None admin] RBAC: Authorizing `identity:get_user(user_id=12bf876ebf134a14ba1ff3cc7c3f7d9a)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:23.729539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b91c6b-ff64-4822-a39a-80f967c2a951 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:23.731388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 109/216] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:23 2022] GET /identity/v3/users/12bf876ebf134a14ba1ff3cc7c3f7d9a => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:23.736828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b91c6b-ff64-4822-a39a-80f967c2a951 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:23.739463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f989ba-9276-4e63-9f7c-74f8401ee742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:23.740480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f989ba-9276-4e63-9f7c-74f8401ee742 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.741016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f989ba-9276-4e63-9f7c-74f8401ee742 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.741492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f989ba-9276-4e63-9f7c-74f8401ee742 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.742438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f989ba-9276-4e63-9f7c-74f8401ee742 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:23.744091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f989ba-9276-4e63-9f7c-74f8401ee742 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:23.779852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 108/217] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:23 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:23.822769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:23.848688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b91c6b-ff64-4822-a39a-80f967c2a951 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:23.879592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561881f8-d406-44c4-9484-820efa1b133a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.879919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561881f8-d406-44c4-9484-820efa1b133a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.880183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561881f8-d406-44c4-9484-820efa1b133a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.881829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 109/218] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:23.886902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb764-0907-4d36-8183-40b4c7b4f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:23.887208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030842a-06fe-4288-894d-5553dc1da204 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.887498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030842a-06fe-4288-894d-5553dc1da204 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.887591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb764-0907-4d36-8183-40b4c7b4f8de None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:23.887804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030842a-06fe-4288-894d-5553dc1da204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.887910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb764-0907-4d36-8183-40b4c7b4f8de None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:23.888210 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860cb764-0907-4d36-8183-40b4c7b4f8de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:23.907104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c030842a-06fe-4288-894d-5553dc1da204 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:23.908811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c030842a-06fe-4288-894d-5553dc1da204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:23.964556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cb764-0907-4d36-8183-40b4c7b4f8de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:23.966077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860cb764-0907-4d36-8183-40b4c7b4f8de None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:24.006016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 110/219] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:24.028924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030842a-06fe-4288-894d-5553dc1da204 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.053552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:24.083340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:24.085881 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 110/220] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:24.091974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb764-0907-4d36-8183-40b4c7b4f8de None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.159071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030842a-06fe-4288-894d-5553dc1da204 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:24.197327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d5f0e-a580-4560-af73-2bda07f61607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:24.198183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d5f0e-a580-4560-af73-2bda07f61607 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.198450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d5f0e-a580-4560-af73-2bda07f61607 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.198726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6d5f0e-a580-4560-af73-2bda07f61607 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.211703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6d5f0e-a580-4560-af73-2bda07f61607 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:24.218018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860cb764-0907-4d36-8183-40b4c7b4f8de None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-da6d5f0e-a580-4560-af73-2bda07f61607 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:24.219414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:24.220329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:24.221114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 111/221] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:24.226755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d5f0e-a580-4560-af73-2bda07f61607 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.269164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b71b-57f4-4b83-ad0f-4d5518c1eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:24.270357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b71b-57f4-4b83-ad0f-4d5518c1eb4e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.270813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b71b-57f4-4b83-ad0f-4d5518c1eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.271285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980b71b-57f4-4b83-ad0f-4d5518c1eb4e None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.273110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980b71b-57f4-4b83-ad0f-4d5518c1eb4e None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:24.274776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d980b71b-57f4-4b83-ad0f-4d5518c1eb4e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:24.277973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 111/222] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:24 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:24.283893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b71b-57f4-4b83-ad0f-4d5518c1eb4e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.334718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:24.339801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6d5f0e-a580-4560-af73-2bda07f61607 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:24.343998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:24.380950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:24.381734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.382028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.382301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.383071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:24.383378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:24.384924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:24.394551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 112/223] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:24.397731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980b71b-57f4-4b83-ad0f-4d5518c1eb4e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:24.400444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.439522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:24.440151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.440434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.440711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.441644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] RBAC: Adding query filter params (role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc, user.id=12bf876ebf134a14ba1ff3cc7c3f7d9a) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:24.441966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:24.443531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:24.449860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 112/224] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:24 2022] GET /identity/v3/role_assignments?user.id=12bf876ebf134a14ba1ff3cc7c3f7d9a&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:24.508626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b122c-4a1d-4b77-84d6-63c87ad0c736 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:24.546426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb17b2d-c76f-4c28-a5ed-ac26034e70fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:24.547349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17b2d-c76f-4c28-a5ed-ac26034e70fd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.547650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17b2d-c76f-4c28-a5ed-ac26034e70fd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.547931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb17b2d-c76f-4c28-a5ed-ac26034e70fd None admin] PATH_INFO: `/v3/users/f7c32427a83b43029671ddf89b73412b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.549206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb17b2d-c76f-4c28-a5ed-ac26034e70fd None admin] RBAC: Authorizing `identity:get_user(user_id=f7c32427a83b43029671ddf89b73412b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:24.550679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb17b2d-c76f-4c28-a5ed-ac26034e70fd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:24.552780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 113/225] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:24 2022] GET /identity/v3/users/f7c32427a83b43029671ddf89b73412b => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:24.558420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.586121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb883d13-c19d-42b1-8d0a-dd471c87eb75 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.586448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb883d13-c19d-42b1-8d0a-dd471c87eb75 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.586685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb883d13-c19d-42b1-8d0a-dd471c87eb75 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.588384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 114/226] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:24.594309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a7e4-f905-4393-a124-a82f0571065b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.594601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a7e4-f905-4393-a124-a82f0571065b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.594871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74a7e4-f905-4393-a124-a82f0571065b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.613685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7b74a7e4-f905-4393-a124-a82f0571065b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:24.615202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7b74a7e4-f905-4393-a124-a82f0571065b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:24.646745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:24.695739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 115/227] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:24.720513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74a7e4-f905-4393-a124-a82f0571065b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.783833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb9fb9-4996-4475-a2d6-b772258b5ec2 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:24.803218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:24.831631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74a7e4-f905-4393-a124-a82f0571065b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:24.850935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff30e-1822-4743-b2bc-df90e186753b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:24.852358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff30e-1822-4743-b2bc-df90e186753b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.852838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff30e-1822-4743-b2bc-df90e186753b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.853301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff30e-1822-4743-b2bc-df90e186753b None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.861052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ff30e-1822-4743-b2bc-df90e186753b None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:24.862746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba62c9-25a0-4ff9-8b99-989fedb877d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:24.863579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba62c9-25a0-4ff9-8b99-989fedb877d8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:24.863825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ff30e-1822-4743-b2bc-df90e186753b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:24.863922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba62c9-25a0-4ff9-8b99-989fedb877d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:24.864142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba62c9-25a0-4ff9-8b99-989fedb877d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:24.868629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 113/228] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:24 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:24.877513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba62c9-25a0-4ff9-8b99-989fedb877d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:24.878732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff30e-1822-4743-b2bc-df90e186753b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-aeba62c9-25a0-4ff9-8b99-989fedb877d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:24.884796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:24.885686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:24.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 116/229] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:24.892247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba62c9-25a0-4ff9-8b99-989fedb877d8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:24.920029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:25.001435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba62c9-25a0-4ff9-8b99-989fedb877d8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:25.035276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:25.035988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:25.036270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:25.036542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:25.037413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:25.037721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:25.039121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:25.047760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 117/230] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:25.053327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:25.064849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff30e-1822-4743-b2bc-df90e186753b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:25.112183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4a02-0217-4609-a5c8-38b8b37a313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:25.113212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4a02-0217-4609-a5c8-38b8b37a313b None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:25.113593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4a02-0217-4609-a5c8-38b8b37a313b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:25.113873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c4a02-0217-4609-a5c8-38b8b37a313b None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/users/f7c32427a83b43029671ddf89b73412b/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:25.116105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c4a02-0217-4609-a5c8-38b8b37a313b None admin] RBAC: Authorizing `identity:create_grant(project_id=ac06e348b2a54d158a10b3bd54365fbc, user_id=f7c32427a83b43029671ddf89b73412b, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:25.117771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c4a02-0217-4609-a5c8-38b8b37a313b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:25.140232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:25.151567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 114/231] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:24 2022] PUT /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/users/f7c32427a83b43029671ddf89b73412b/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:27:25.157439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a1494-3917-41e5-bc03-203f9c6ad552 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:25.195215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35a580-6f21-489b-a34d-070ab465318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:25.196164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35a580-6f21-489b-a34d-070ab465318a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:25.196444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35a580-6f21-489b-a34d-070ab465318a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:25.196750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e35a580-6f21-489b-a34d-070ab465318a None admin] PATH_INFO: `/v3/users/f7c32427a83b43029671ddf89b73412b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:25.198036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35a580-6f21-489b-a34d-070ab465318a None admin] RBAC: Authorizing `identity:get_user(user_id=f7c32427a83b43029671ddf89b73412b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:25.199582 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e35a580-6f21-489b-a34d-070ab465318a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:25.202332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 118/232] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:25 2022] GET /identity/v3/users/f7c32427a83b43029671ddf89b73412b => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:25.208051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4a02-0217-4609-a5c8-38b8b37a313b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:25.253676 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:25.349185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c4a02-0217-4609-a5c8-38b8b37a313b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:25.388849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83fa23-f97a-48ec-8098-68598a32c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:25.389812 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83fa23-f97a-48ec-8098-68598a32c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:25.390086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83fa23-f97a-48ec-8098-68598a32c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:25.390362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83fa23-f97a-48ec-8098-68598a32c2d6 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:25.391626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83fa23-f97a-48ec-8098-68598a32c2d6 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:25.393184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c83fa23-f97a-48ec-8098-68598a32c2d6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:25.395223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 115/233] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:25 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:25.400937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35a580-6f21-489b-a34d-070ab465318a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:25.503369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e35a580-6f21-489b-a34d-070ab465318a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:25.536984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c05d84-fe17-456c-b5e0-daf28934068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:25.537809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c05d84-fe17-456c-b5e0-daf28934068b None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:25.538085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c05d84-fe17-456c-b5e0-daf28934068b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:25.538357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c05d84-fe17-456c-b5e0-daf28934068b None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/users/f7c32427a83b43029671ddf89b73412b/roles/f473c53d5223450d931d5e666473c86b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:25.540674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c05d84-fe17-456c-b5e0-daf28934068b None admin] RBAC: Authorizing `identity:create_grant(project_id=ac06e348b2a54d158a10b3bd54365fbc, user_id=f7c32427a83b43029671ddf89b73412b, role_id=f473c53d5223450d931d5e666473c86b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:25.542180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c05d84-fe17-456c-b5e0-daf28934068b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:25.562079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 119/234] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:25 2022] PUT /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/users/f7c32427a83b43029671ddf89b73412b/roles/f473c53d5223450d931d5e666473c86b => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:27:26.342077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b310bd-7551-40d7-8e15-42a65584a62a None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:26.342633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b310bd-7551-40d7-8e15-42a65584a62a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:26.342633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b310bd-7551-40d7-8e15-42a65584a62a None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:26.344264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 116/235] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:26.351633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af45dc-40aa-4b4f-a13d-f0114a62a70b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:26.351633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af45dc-40aa-4b4f-a13d-f0114a62a70b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:26.351633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af45dc-40aa-4b4f-a13d-f0114a62a70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:26.372629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-62af45dc-40aa-4b4f-a13d-f0114a62a70b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:26.374169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-62af45dc-40aa-4b4f-a13d-f0114a62a70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:26.383501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:26.474141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 120/236] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:26.516294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b310bd-7551-40d7-8e15-42a65584a62a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:26.661028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b310bd-7551-40d7-8e15-42a65584a62a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:26.663408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:26.696540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34b40cd-c8b2-4483-abc2-c748827f74c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:26.697411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b40cd-c8b2-4483-abc2-c748827f74c3 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:26.697694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b40cd-c8b2-4483-abc2-c748827f74c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:26.697970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34b40cd-c8b2-4483-abc2-c748827f74c3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:26.708398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34b40cd-c8b2-4483-abc2-c748827f74c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-c34b40cd-c8b2-4483-abc2-c748827f74c3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:26.716222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:26.717127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:26.718101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 117/237] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:26.723484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af45dc-40aa-4b4f-a13d-f0114a62a70b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:26.769955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43bffd-a7a7-4048-8944-86abe1bb7a97 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:26.770278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43bffd-a7a7-4048-8944-86abe1bb7a97 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:26.770507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43bffd-a7a7-4048-8944-86abe1bb7a97 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:26.772152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 118/238] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:26.777413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9edb-a3b5-4702-98ce-951f56ee74af None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:26.778047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9edb-a3b5-4702-98ce-951f56ee74af None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:26.778464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab9edb-a3b5-4702-98ce-951f56ee74af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:26.795782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-92ab9edb-a3b5-4702-98ce-951f56ee74af None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:26.797184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-92ab9edb-a3b5-4702-98ce-951f56ee74af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:26.898355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af45dc-40aa-4b4f-a13d-f0114a62a70b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:26.904220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 119/239] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:26.946737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab9edb-a3b5-4702-98ce-951f56ee74af None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:26.957760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84891bb-1486-4074-9a82-b4fe7b9901b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:26.958504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84891bb-1486-4074-9a82-b4fe7b9901b7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:26.958788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84891bb-1486-4074-9a82-b4fe7b9901b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:26.959063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84891bb-1486-4074-9a82-b4fe7b9901b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:26.959919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84891bb-1486-4074-9a82-b4fe7b9901b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:26.959919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84891bb-1486-4074-9a82-b4fe7b9901b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:26.962257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84891bb-1486-4074-9a82-b4fe7b9901b7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:26.973803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 121/240] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:26.975090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b54864-f372-4b3c-aacc-4a7793932a8e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:26.975374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b54864-f372-4b3c-aacc-4a7793932a8e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:26.975673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b54864-f372-4b3c-aacc-4a7793932a8e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:26.977580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 122/241] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:26.980566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b54864-f372-4b3c-aacc-4a7793932a8e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:26.987103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.051756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.058815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab9edb-a3b5-4702-98ce-951f56ee74af None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:27.089809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b54864-f372-4b3c-aacc-4a7793932a8e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:27.098301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0156e-d4e2-42ce-a47b-50a7e36f8f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:27.099372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0156e-d4e2-42ce-a47b-50a7e36f8f4e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.099855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0156e-d4e2-42ce-a47b-50a7e36f8f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.100302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0156e-d4e2-42ce-a47b-50a7e36f8f4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.101646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0156e-d4e2-42ce-a47b-50a7e36f8f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:27.103322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0156e-d4e2-42ce-a47b-50a7e36f8f4e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:27.105530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 120/242] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:27.106913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdeaa1-c02e-4968-9166-0855234d409d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.107431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdeaa1-c02e-4968-9166-0855234d409d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.108024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdeaa1-c02e-4968-9166-0855234d409d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.131938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-61cdeaa1-c02e-4968-9166-0855234d409d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:27.133773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-61cdeaa1-c02e-4968-9166-0855234d409d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:27.138621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad072e9-93db-4020-82a5-50f66ea957f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:27.139761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad072e9-93db-4020-82a5-50f66ea957f9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.140219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad072e9-93db-4020-82a5-50f66ea957f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.140662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad072e9-93db-4020-82a5-50f66ea957f9 None admin] PATH_INFO: `/v3/users/3ec85bfda2e74900b9d9efd63d7043e8` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.157751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad072e9-93db-4020-82a5-50f66ea957f9 None admin] RBAC: Authorizing `identity:get_user(user_id=3ec85bfda2e74900b9d9efd63d7043e8)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:27.160405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad072e9-93db-4020-82a5-50f66ea957f9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:27.163360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 123/243] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:26 2022] GET /identity/v3/users/3ec85bfda2e74900b9d9efd63d7043e8 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:27.164833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad072e9-93db-4020-82a5-50f66ea957f9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:27.211941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 121/244] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:27.213108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdeaa1-c02e-4968-9166-0855234d409d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:27.251501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.298289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad072e9-93db-4020-82a5-50f66ea957f9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:27.312073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.317274 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdeaa1-c02e-4968-9166-0855234d409d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:27.342057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe24437-18ff-4719-83ac-14c603ce4d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:27.342743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24437-18ff-4719-83ac-14c603ce4d93 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.343024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24437-18ff-4719-83ac-14c603ce4d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.343295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24437-18ff-4719-83ac-14c603ce4d93 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.344066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24437-18ff-4719-83ac-14c603ce4d93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:27.345617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24437-18ff-4719-83ac-14c603ce4d93 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:27.372314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 124/245] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:27 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:27.382157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209fc82-31e0-4e23-83fa-71d8d2d2acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:27.382998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209fc82-31e0-4e23-83fa-71d8d2d2acdf None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.383380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209fc82-31e0-4e23-83fa-71d8d2d2acdf None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.383848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209fc82-31e0-4e23-83fa-71d8d2d2acdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.384302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe24437-18ff-4719-83ac-14c603ce4d93 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:27.472471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209fc82-31e0-4e23-83fa-71d8d2d2acdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:27.474809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209fc82-31e0-4e23-83fa-71d8d2d2acdf None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:27.585501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.599828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 122/246] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:27.608698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209fc82-31e0-4e23-83fa-71d8d2d2acdf None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:27.638651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe24437-18ff-4719-83ac-14c603ce4d93 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:27.662000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.691946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0489b-63b8-4eb6-96e2-ac20bf87f13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:27.693174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0489b-63b8-4eb6-96e2-ac20bf87f13f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.693664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0489b-63b8-4eb6-96e2-ac20bf87f13f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.694133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0489b-63b8-4eb6-96e2-ac20bf87f13f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.706691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e0489b-63b8-4eb6-96e2-ac20bf87f13f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c6e0489b-63b8-4eb6-96e2-ac20bf87f13f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:27.714739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:27.715975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:27.716840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:27.719179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 125/247] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:27.725256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928b43f-6b69-4850-9f20-421ecc76127c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.725729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209fc82-31e0-4e23-83fa-71d8d2d2acdf None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:27.726003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928b43f-6b69-4850-9f20-421ecc76127c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.726297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928b43f-6b69-4850-9f20-421ecc76127c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.727872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 126/248] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:27.729108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928b43f-6b69-4850-9f20-421ecc76127c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:27.766656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb53e84-f19d-4867-803a-a1343dd35577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:27.767702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53e84-f19d-4867-803a-a1343dd35577 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.767985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53e84-f19d-4867-803a-a1343dd35577 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.768264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb53e84-f19d-4867-803a-a1343dd35577 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.770327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb53e84-f19d-4867-803a-a1343dd35577 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:27.772180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb53e84-f19d-4867-803a-a1343dd35577 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:27.774281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 123/249] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:27 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:27.775498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cbfe8-ccaa-43ca-af4c-2ed6060155a6 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.775850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cbfe8-ccaa-43ca-af4c-2ed6060155a6 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.776123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2cbfe8-ccaa-43ca-af4c-2ed6060155a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.795655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-db2cbfe8-ccaa-43ca-af4c-2ed6060155a6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:27.797069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-db2cbfe8-ccaa-43ca-af4c-2ed6060155a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:27.860627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d928b43f-6b69-4850-9f20-421ecc76127c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:27.877504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:27.891770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 124/250] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:27.893139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cbfe8-ccaa-43ca-af4c-2ed6060155a6 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:27.902962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:27.903777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:27.904065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:27.904343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:27.905136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:27.905440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:27.906937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:27.916470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 127/251] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:27.917440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:27.964956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:28.031276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2cbfe8-ccaa-43ca-af4c-2ed6060155a6 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:28.037732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c203ca-d6de-4896-a21e-76f52a0dd2a4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:28.070901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:28.071570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.071874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.072144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.073505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] RBAC: Adding query filter params (role.id=c61c0210f997401eb1ea6dc7bbdcfe25, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc, user.id=3ec85bfda2e74900b9d9efd63d7043e8) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:28.073995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:28.075496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:28.081828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 125/252] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:27 2022] GET /identity/v3/role_assignments?user.id=3ec85bfda2e74900b9d9efd63d7043e8&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=c61c0210f997401eb1ea6dc7bbdcfe25 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:28.083179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:28.124315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05d448-bd1b-4991-97ec-f1e1b7fc4d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:28.125187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05d448-bd1b-4991-97ec-f1e1b7fc4d2f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.125465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05d448-bd1b-4991-97ec-f1e1b7fc4d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.125734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05d448-bd1b-4991-97ec-f1e1b7fc4d2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.153933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05d448-bd1b-4991-97ec-f1e1b7fc4d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ef05d448-bd1b-4991-97ec-f1e1b7fc4d2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:28.162855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:28.163794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:28.164601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 128/253] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:28.171790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05d448-bd1b-4991-97ec-f1e1b7fc4d2f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:28.208427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:28.336019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bce16-1a67-47e5-90c6-d60cad4fdf1b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:28.377891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da074-e88e-47d9-814b-0deaebdda232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:28.379080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da074-e88e-47d9-814b-0deaebdda232 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.379957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da074-e88e-47d9-814b-0deaebdda232 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.380376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111da074-e88e-47d9-814b-0deaebdda232 None admin] PATH_INFO: `/v3/users/12bf876ebf134a14ba1ff3cc7c3f7d9a` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.381824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111da074-e88e-47d9-814b-0deaebdda232 None admin] RBAC: Authorizing `identity:get_user(user_id=12bf876ebf134a14ba1ff3cc7c3f7d9a)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:28.383849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111da074-e88e-47d9-814b-0deaebdda232 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:28.386681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 126/254] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:28 2022] GET /identity/v3/users/12bf876ebf134a14ba1ff3cc7c3f7d9a => generated 297 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:28.392469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da074-e88e-47d9-814b-0deaebdda232 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:28.397026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:28.400552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05d448-bd1b-4991-97ec-f1e1b7fc4d2f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:28.496370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176d8f3-746e-43ff-a6c8-9547c038bf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:28.497455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d8f3-746e-43ff-a6c8-9547c038bf9f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.497885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d8f3-746e-43ff-a6c8-9547c038bf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.498301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d8f3-746e-43ff-a6c8-9547c038bf9f None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.499234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176d8f3-746e-43ff-a6c8-9547c038bf9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:28.499732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176d8f3-746e-43ff-a6c8-9547c038bf9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:28.501322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176d8f3-746e-43ff-a6c8-9547c038bf9f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:28.518103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 129/255] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:28.522380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77a7b-399c-4c43-a09c-4fb49dcd2f07 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.522860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77a7b-399c-4c43-a09c-4fb49dcd2f07 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.523283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf77a7b-399c-4c43-a09c-4fb49dcd2f07 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.524805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 130/256] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:28.525652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf77a7b-399c-4c43-a09c-4fb49dcd2f07 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:28.551938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111da074-e88e-47d9-814b-0deaebdda232 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:28.597117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:28.620844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58deb9-0a8c-4498-96e3-447897543a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:28.622112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58deb9-0a8c-4498-96e3-447897543a69 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.624046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58deb9-0a8c-4498-96e3-447897543a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.625244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58deb9-0a8c-4498-96e3-447897543a69 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.628126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58deb9-0a8c-4498-96e3-447897543a69 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:28.631462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58deb9-0a8c-4498-96e3-447897543a69 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:28.637174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 127/257] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:28 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:28.638762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4db61-bb52-4eca-a079-486a08cd725b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.640256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4db61-bb52-4eca-a079-486a08cd725b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.641447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4db61-bb52-4eca-a079-486a08cd725b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.677392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-c3d4db61-bb52-4eca-a079-486a08cd725b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:28.680520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c3d4db61-bb52-4eca-a079-486a08cd725b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:28.743445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf77a7b-399c-4c43-a09c-4fb49dcd2f07 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:28.797857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 128/258] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:28.798815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4db61-bb52-4eca-a079-486a08cd725b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:28.808284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85061c9a-4158-4602-83a6-b77f0c760e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:28.809642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85061c9a-4158-4602-83a6-b77f0c760e70 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.810421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85061c9a-4158-4602-83a6-b77f0c760e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.810800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85061c9a-4158-4602-83a6-b77f0c760e70 None admin] PATH_INFO: `/v3/users/f7c32427a83b43029671ddf89b73412b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.815419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85061c9a-4158-4602-83a6-b77f0c760e70 None admin] RBAC: Authorizing `identity:get_user(user_id=f7c32427a83b43029671ddf89b73412b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:28.817119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85061c9a-4158-4602-83a6-b77f0c760e70 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:28.818818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 131/259] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:28 2022] GET /identity/v3/users/f7c32427a83b43029671ddf89b73412b => generated 283 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:28.837453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85061c9a-4158-4602-83a6-b77f0c760e70 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:28.901200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4db61-bb52-4eca-a079-486a08cd725b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:28.907968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:28.931964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:28.947206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958f557-c6aa-4491-b778-38c5fe573b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:28.948154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958f557-c6aa-4491-b778-38c5fe573b0e None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:28.948429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958f557-c6aa-4491-b778-38c5fe573b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:28.948698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958f557-c6aa-4491-b778-38c5fe573b0e None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/users/12bf876ebf134a14ba1ff3cc7c3f7d9a/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:28.951884 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958f557-c6aa-4491-b778-38c5fe573b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=ac06e348b2a54d158a10b3bd54365fbc, user_id=12bf876ebf134a14ba1ff3cc7c3f7d9a, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:28.953329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958f557-c6aa-4491-b778-38c5fe573b0e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:28.974727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 129/260] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:28 2022] PUT /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/users/12bf876ebf134a14ba1ff3cc7c3f7d9a/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:28.975423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958f557-c6aa-4491-b778-38c5fe573b0e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:29.045323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85061c9a-4158-4602-83a6-b77f0c760e70 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:29.128984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016571c2-121f-4fad-89e6-bd44cc08a368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:29.129677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016571c2-121f-4fad-89e6-bd44cc08a368 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:29.129961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016571c2-121f-4fad-89e6-bd44cc08a368 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:29.130240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016571c2-121f-4fad-89e6-bd44cc08a368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:29.151585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958f557-c6aa-4491-b778-38c5fe573b0e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:29.235574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e299-8ba0-44c2-acfa-db495684aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:29.236467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e299-8ba0-44c2-acfa-db495684aabd None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:29.236750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e299-8ba0-44c2-acfa-db495684aabd None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:29.237030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6e299-8ba0-44c2-acfa-db495684aabd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:29.252238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6e299-8ba0-44c2-acfa-db495684aabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-4eb6e299-8ba0-44c2-acfa-db495684aabd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:29.260813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:29.261738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:29.262531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 130/261] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:29.267988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e299-8ba0-44c2-acfa-db495684aabd None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:29.277570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016571c2-121f-4fad-89e6-bd44cc08a368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:29.279108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016571c2-121f-4fad-89e6-bd44cc08a368 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:29.332006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:29.349593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:29.451826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6e299-8ba0-44c2-acfa-db495684aabd None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:29.453593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 132/262] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:29.457684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016571c2-121f-4fad-89e6-bd44cc08a368 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:29.515200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:29.515952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:29.516240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:29.516514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:29.517282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:29.517592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:29.518985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:29.527738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 131/263] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:29.533201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:29.634536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016571c2-121f-4fad-89e6-bd44cc08a368 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:29.687574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38b5a7-1220-43f5-b84b-be831f93df27 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:29.712060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:29.722331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:29.725638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aee31b-e933-4615-824b-cc4c668f5867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:29.726551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee31b-e933-4615-824b-cc4c668f5867 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:29.726841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee31b-e933-4615-824b-cc4c668f5867 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:29.727961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee31b-e933-4615-824b-cc4c668f5867 None admin] PATH_INFO: `/v3/users/f7c32427a83b43029671ddf89b73412b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:29.729222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aee31b-e933-4615-824b-cc4c668f5867 None admin] RBAC: Authorizing `identity:get_user(user_id=f7c32427a83b43029671ddf89b73412b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:29.730710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aee31b-e933-4615-824b-cc4c668f5867 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:29.732756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 132/264] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:29 2022] GET /identity/v3/users/f7c32427a83b43029671ddf89b73412b => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:29.733708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabf63e-a552-4037-9cc2-4e2cef041def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:29.734593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabf63e-a552-4037-9cc2-4e2cef041def None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:29.734873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabf63e-a552-4037-9cc2-4e2cef041def None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:29.735145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabf63e-a552-4037-9cc2-4e2cef041def None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:29.740642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aee31b-e933-4615-824b-cc4c668f5867 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:29.744467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabf63e-a552-4037-9cc2-4e2cef041def None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:29.746003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabf63e-a552-4037-9cc2-4e2cef041def None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:29.748357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 133/265] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:29 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:29.756595 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabf63e-a552-4037-9cc2-4e2cef041def None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:29.886173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabf63e-a552-4037-9cc2-4e2cef041def None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:29.919980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed179d9f-3ac0-4054-a5eb-8a2c853e2014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:29.920673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179d9f-3ac0-4054-a5eb-8a2c853e2014 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:29.920956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179d9f-3ac0-4054-a5eb-8a2c853e2014 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:29.921229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed179d9f-3ac0-4054-a5eb-8a2c853e2014 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:29.922070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed179d9f-3ac0-4054-a5eb-8a2c853e2014 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc, user.id=f7c32427a83b43029671ddf89b73412b) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:29.922380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed179d9f-3ac0-4054-a5eb-8a2c853e2014 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:29.923854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed179d9f-3ac0-4054-a5eb-8a2c853e2014 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:29.929976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 134/266] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:29 2022] GET /identity/v3/role_assignments?user.id=f7c32427a83b43029671ddf89b73412b&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:30.018681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aee31b-e933-4615-824b-cc4c668f5867 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:30.058819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069bd9-4c08-4b86-b31e-575aeb6ff603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:30.059859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069bd9-4c08-4b86-b31e-575aeb6ff603 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.060140 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069bd9-4c08-4b86-b31e-575aeb6ff603 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.060413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6069bd9-4c08-4b86-b31e-575aeb6ff603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.101047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:30.139989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069bd9-4c08-4b86-b31e-575aeb6ff603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:30.141867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6069bd9-4c08-4b86-b31e-575aeb6ff603 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:30.245500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 133/267] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:30.251404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b00221-f9aa-4c92-b04b-e20cd94d7e93 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.251743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b00221-f9aa-4c92-b04b-e20cd94d7e93 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.251849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069bd9-4c08-4b86-b31e-575aeb6ff603 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:30.252024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b00221-f9aa-4c92-b04b-e20cd94d7e93 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.253672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 135/268] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:30.258699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cab17-7341-4e05-8ff8-ee37345dcc69 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.258982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cab17-7341-4e05-8ff8-ee37345dcc69 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.259256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cab17-7341-4e05-8ff8-ee37345dcc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.281256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e85cab17-7341-4e05-8ff8-ee37345dcc69 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:30.282647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e85cab17-7341-4e05-8ff8-ee37345dcc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:30.333772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:30.351114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:30.367741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 136/269] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:30.372072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6069bd9-4c08-4b86-b31e-575aeb6ff603 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:30.402881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cab17-7341-4e05-8ff8-ee37345dcc69 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:30.426824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123894-d326-4d2b-9c0c-4789e460eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:30.429150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123894-d326-4d2b-9c0c-4789e460eb90 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.429433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123894-d326-4d2b-9c0c-4789e460eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.429703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91123894-d326-4d2b-9c0c-4789e460eb90 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.431726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91123894-d326-4d2b-9c0c-4789e460eb90 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:30.433255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91123894-d326-4d2b-9c0c-4789e460eb90 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:30.439641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 134/270] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:30 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:30.441834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123894-d326-4d2b-9c0c-4789e460eb90 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:30.522145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85cab17-7341-4e05-8ff8-ee37345dcc69 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:30.542771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91123894-d326-4d2b-9c0c-4789e460eb90 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:30.557650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834741c0-52cf-46a3-b37a-9020e01e9056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:30.558753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834741c0-52cf-46a3-b37a-9020e01e9056 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.559541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834741c0-52cf-46a3-b37a-9020e01e9056 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.560083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834741c0-52cf-46a3-b37a-9020e01e9056 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.570472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834741c0-52cf-46a3-b37a-9020e01e9056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:30.577352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42793e43-076b-4835-bd9d-605c001eafaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:30.578014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793e43-076b-4835-bd9d-605c001eafaf None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.578298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793e43-076b-4835-bd9d-605c001eafaf None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.578572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42793e43-076b-4835-bd9d-605c001eafaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.579416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42793e43-076b-4835-bd9d-605c001eafaf None admin] RBAC: Adding query filter params (role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc, user.id=f7c32427a83b43029671ddf89b73412b) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:30.579762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42793e43-076b-4835-bd9d-605c001eafaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-834741c0-52cf-46a3-b37a-9020e01e9056 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:30.580300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:30.581179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:30.581968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:30.582587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42793e43-076b-4835-bd9d-605c001eafaf None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:30.584432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 137/271] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:30.585972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590d98-0e70-4801-a1fc-770f04177ee4 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.586566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590d98-0e70-4801-a1fc-770f04177ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.587023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf590d98-0e70-4801-a1fc-770f04177ee4 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.588526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 138/272] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:30.590695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590d98-0e70-4801-a1fc-770f04177ee4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:30.595626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 135/273] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:30 2022] GET /identity/v3/role_assignments?user.id=f7c32427a83b43029671ddf89b73412b&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=f473c53d5223450d931d5e666473c86b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:30.595626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf29ac-85be-4872-b797-94d14702cc9a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.595626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf29ac-85be-4872-b797-94d14702cc9a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.595626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf29ac-85be-4872-b797-94d14702cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.599930 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:30.615098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1edf29ac-85be-4872-b797-94d14702cc9a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:30.616164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1edf29ac-85be-4872-b797-94d14702cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:30.693209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 136/274] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:30.701968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:30.729227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf29ac-85be-4872-b797-94d14702cc9a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:30.820912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf590d98-0e70-4801-a1fc-770f04177ee4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:30.854197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf29ac-85be-4872-b797-94d14702cc9a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:30.863369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:30.864404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.864932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.868225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.869348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:30.869850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:30.871462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:30.880707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 139/275] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:30.888858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:30.897665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:30.907134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bb01-12e1-4005-9b25-3145b709801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:30.908008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bb01-12e1-4005-9b25-3145b709801a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:30.908290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bb01-12e1-4005-9b25-3145b709801a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:30.908562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df6bb01-12e1-4005-9b25-3145b709801a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:30.909975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6bb01-12e1-4005-9b25-3145b709801a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:30.912228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df6bb01-12e1-4005-9b25-3145b709801a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:30.914641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 137/276] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:30.921103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bb01-12e1-4005-9b25-3145b709801a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:31.003429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e2328-1673-47be-9f78-2c0c63952779 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:31.036025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:31.044388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8274625d-0e89-4858-b538-671b8a5958cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:31.045385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274625d-0e89-4858-b538-671b8a5958cb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.045821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274625d-0e89-4858-b538-671b8a5958cb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.046140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274625d-0e89-4858-b538-671b8a5958cb None admin] PATH_INFO: `/v3/users/1fb5b12b7ba54500aee2f94e07b55fca` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.051775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df6bb01-12e1-4005-9b25-3145b709801a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:31.066026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274625d-0e89-4858-b538-671b8a5958cb None admin] RBAC: Authorizing `identity:get_user(user_id=1fb5b12b7ba54500aee2f94e07b55fca)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:31.067493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8274625d-0e89-4858-b538-671b8a5958cb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:31.069354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 140/277] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:30 2022] GET /identity/v3/users/1fb5b12b7ba54500aee2f94e07b55fca => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:31.070692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562e2a-b724-4f7d-aaa1-d3866e687dc9 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.071023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562e2a-b724-4f7d-aaa1-d3866e687dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.071301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b562e2a-b724-4f7d-aaa1-d3866e687dc9 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.072685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 141/278] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:31.076439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b562e2a-b724-4f7d-aaa1-d3866e687dc9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:31.097937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df9991-1b01-496e-84d4-32b728d2aba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:31.098630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9991-1b01-496e-84d4-32b728d2aba0 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.098910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9991-1b01-496e-84d4-32b728d2aba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.099184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df9991-1b01-496e-84d4-32b728d2aba0 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.099945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df9991-1b01-496e-84d4-32b728d2aba0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:31.101475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df9991-1b01-496e-84d4-32b728d2aba0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:31.123202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 138/279] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:30 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:27:31.124860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3f043-9825-4f6b-8151-6a61bf5f13b6 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.125316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3f043-9825-4f6b-8151-6a61bf5f13b6 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.126265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3f043-9825-4f6b-8151-6a61bf5f13b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.148820 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e6b3f043-9825-4f6b-8151-6a61bf5f13b6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:31.151385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e6b3f043-9825-4f6b-8151-6a61bf5f13b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:31.204298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b562e2a-b724-4f7d-aaa1-d3866e687dc9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:31.222221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:31.251637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 139/280] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:31.252966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:31.253771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.254060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.254387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.255327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] RBAC: Adding query filter params (role.id=edb5b1408bc94aefa62e360a44fa0940, user.id=1fb5b12b7ba54500aee2f94e07b55fca, scope.system=all) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:31.255727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:31.257364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:31.263748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 142/281] 10.222.0.64 () {56 vars in 1308 bytes} [Tue Jul 12 13:27:31 2022] GET /identity/v3/role_assignments?user.id=1fb5b12b7ba54500aee2f94e07b55fca&scope.system=all&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:31.275129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3f043-9825-4f6b-8151-6a61bf5f13b6 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:31.400173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3f043-9825-4f6b-8151-6a61bf5f13b6 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:31.442986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0be0f-c724-4f9f-a646-9bece5d9a30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:31.444682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0be0f-c724-4f9f-a646-9bece5d9a30f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.445007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0be0f-c724-4f9f-a646-9bece5d9a30f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.445370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0be0f-c724-4f9f-a646-9bece5d9a30f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.461978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f0be0f-c724-4f9f-a646-9bece5d9a30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-e7f0be0f-c724-4f9f-a646-9bece5d9a30f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:31.470771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:31.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:31.472520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:31.473487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 140/282] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:31.478605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:31.523664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:31.596927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f721c9ef-b12f-45c5-870a-878b93869741 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:31.633592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:31.634275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.634557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.634832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.635588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:31.635921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:31.637287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:31.663213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 143/283] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:31.664641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0be0f-c724-4f9f-a646-9bece5d9a30f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:31.718509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:31.782276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0be0f-c724-4f9f-a646-9bece5d9a30f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:31.828236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeebced-1dbe-493c-bbd5-8026626788e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:31.829172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebced-1dbe-493c-bbd5-8026626788e1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.829450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebced-1dbe-493c-bbd5-8026626788e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.829723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeebced-1dbe-493c-bbd5-8026626788e1 None admin] PATH_INFO: `/v3/users/3ec85bfda2e74900b9d9efd63d7043e8` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.830973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeebced-1dbe-493c-bbd5-8026626788e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3ec85bfda2e74900b9d9efd63d7043e8)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:31.832440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeebced-1dbe-493c-bbd5-8026626788e1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:31.838921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 141/284] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:31 2022] GET /identity/v3/users/3ec85bfda2e74900b9d9efd63d7043e8 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:31.840405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:31.974637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7ea1-d07b-4d37-a550-217359c6aa4b None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.974824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7ea1-d07b-4d37-a550-217359c6aa4b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.975093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b7ea1-d07b-4d37-a550-217359c6aa4b None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.976622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 142/285] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:31.983152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e2f9c-ef1e-4134-bd5d-141109142f0f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:31.983430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e2f9c-ef1e-4134-bd5d-141109142f0f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:31.983732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e2f9c-ef1e-4134-bd5d-141109142f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:31.984477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad66543-f573-4933-88e5-30fff401be06 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:31.987898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:32.004789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-385e2f9c-ef1e-4134-bd5d-141109142f0f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:32.006500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-385e2f9c-ef1e-4134-bd5d-141109142f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:32.062162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5367151-f5da-4159-a004-0c5164fca13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:32.064332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5367151-f5da-4159-a004-0c5164fca13f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:32.064622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5367151-f5da-4159-a004-0c5164fca13f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:32.066129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5367151-f5da-4159-a004-0c5164fca13f None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:32.070185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5367151-f5da-4159-a004-0c5164fca13f None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:32.072332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5367151-f5da-4159-a004-0c5164fca13f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:32.074320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 144/286] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:31 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:32.081720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5367151-f5da-4159-a004-0c5164fca13f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:32.120476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 143/287] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:32.146195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e2f9c-ef1e-4134-bd5d-141109142f0f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:32.236536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:32.262032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5367151-f5da-4159-a004-0c5164fca13f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:32.297653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49966335-323b-403a-95ab-43be3747f248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:32.298678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49966335-323b-403a-95ab-43be3747f248 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:32.298959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49966335-323b-403a-95ab-43be3747f248 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:32.299273 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49966335-323b-403a-95ab-43be3747f248 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/users/3ec85bfda2e74900b9d9efd63d7043e8/roles/c61c0210f997401eb1ea6dc7bbdcfe25` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:32.301269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49966335-323b-403a-95ab-43be3747f248 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac06e348b2a54d158a10b3bd54365fbc, user_id=3ec85bfda2e74900b9d9efd63d7043e8, role_id=c61c0210f997401eb1ea6dc7bbdcfe25)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:32.302737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49966335-323b-403a-95ab-43be3747f248 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:32.321365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 145/288] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:27:32 2022] PUT /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/users/3ec85bfda2e74900b9d9efd63d7043e8/roles/c61c0210f997401eb1ea6dc7bbdcfe25 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:27:32.351237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e2f9c-ef1e-4134-bd5d-141109142f0f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:32.391184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc5210-6957-48d6-b89f-6ff0c6218a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:32.392126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5210-6957-48d6-b89f-6ff0c6218a67 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:32.392414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5210-6957-48d6-b89f-6ff0c6218a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:32.392686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc5210-6957-48d6-b89f-6ff0c6218a67 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:32.405231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc5210-6957-48d6-b89f-6ff0c6218a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-5ffc5210-6957-48d6-b89f-6ff0c6218a67 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:32.414200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:32.415181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:32.416058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:32.420818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 144/289] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:32.424089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49966335-323b-403a-95ab-43be3747f248 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:32.455552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:32.538285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49966335-323b-403a-95ab-43be3747f248 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:32.577255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:32.577986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:32.578271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:32.578552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:32.579354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:32.579690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:32.581114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:32.593340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 146/290] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:32.596529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc5210-6957-48d6-b89f-6ff0c6218a67 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:32.719775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc5210-6957-48d6-b89f-6ff0c6218a67 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:32.722917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:32.773254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6c84-ef6d-40a1-855d-3f77b920d5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:32.774406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6c84-ef6d-40a1-855d-3f77b920d5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:32.774822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6c84-ef6d-40a1-855d-3f77b920d5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:32.775227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6c84-ef6d-40a1-855d-3f77b920d5e6 None admin] PATH_INFO: `/v3/users/12bf876ebf134a14ba1ff3cc7c3f7d9a` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:32.776628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea6c84-ef6d-40a1-855d-3f77b920d5e6 None admin] RBAC: Authorizing `identity:get_user(user_id=12bf876ebf134a14ba1ff3cc7c3f7d9a)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:32.778244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea6c84-ef6d-40a1-855d-3f77b920d5e6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:32.783713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 145/291] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:32 2022] GET /identity/v3/users/12bf876ebf134a14ba1ff3cc7c3f7d9a => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:32.786317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:32.877211 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:32.889252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df0a1b-7cb7-4d59-8f54-a208511de93b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:32.925185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b656-8fc3-41af-bafe-b30489680875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:32.925845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b656-8fc3-41af-bafe-b30489680875 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:32.926124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b656-8fc3-41af-bafe-b30489680875 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:32.926396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b656-8fc3-41af-bafe-b30489680875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:32.992579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b656-8fc3-41af-bafe-b30489680875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:32.994057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1576b656-8fc3-41af-bafe-b30489680875 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:33.078283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:33.095616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 147/292] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:33.096961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6c84-ef6d-40a1-855d-3f77b920d5e6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:33.193493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6c84-ef6d-40a1-855d-3f77b920d5e6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:33.245681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735359e-e68f-4caa-bdc3-022a03ec5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:33.246614 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735359e-e68f-4caa-bdc3-022a03ec5860 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:33.246894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735359e-e68f-4caa-bdc3-022a03ec5860 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:33.247218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735359e-e68f-4caa-bdc3-022a03ec5860 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:33.248476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735359e-e68f-4caa-bdc3-022a03ec5860 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:33.249939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735359e-e68f-4caa-bdc3-022a03ec5860 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:33.251992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 146/293] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:33 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:33.257674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b656-8fc3-41af-bafe-b30489680875 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:33.382054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b656-8fc3-41af-bafe-b30489680875 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:33.417465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac88a02-46ac-40b2-b9bd-661b41a194c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:33.418169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88a02-46ac-40b2-b9bd-661b41a194c9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:33.418459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88a02-46ac-40b2-b9bd-661b41a194c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:33.418728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac88a02-46ac-40b2-b9bd-661b41a194c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:33.419683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac88a02-46ac-40b2-b9bd-661b41a194c9 None admin] RBAC: Adding query filter params (role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc, user.id=12bf876ebf134a14ba1ff3cc7c3f7d9a) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:33.420054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac88a02-46ac-40b2-b9bd-661b41a194c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:33.421567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac88a02-46ac-40b2-b9bd-661b41a194c9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:33.428710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 148/294] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:33 2022] GET /identity/v3/role_assignments?user.id=12bf876ebf134a14ba1ff3cc7c3f7d9a&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:33.769608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7360-a597-4e22-abe1-bba2a32ce6ea None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:33.770115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7360-a597-4e22-abe1-bba2a32ce6ea None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:33.770213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7e7360-a597-4e22-abe1-bba2a32ce6ea None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:33.771946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 147/295] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:33.777284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6df1b-63d3-4118-8ac3-18c4d1674390 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:33.777573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6df1b-63d3-4118-8ac3-18c4d1674390 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:33.777852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6df1b-63d3-4118-8ac3-18c4d1674390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:33.798731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-60b6df1b-63d3-4118-8ac3-18c4d1674390 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:33.800364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-60b6df1b-63d3-4118-8ac3-18c4d1674390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:33.859628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:33.882773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 149/296] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:33.908677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7360-a597-4e22-abe1-bba2a32ce6ea None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:33.959235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49178270-008c-48f0-8bd3-1e97e9728e05 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:33.959544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49178270-008c-48f0-8bd3-1e97e9728e05 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:33.959817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49178270-008c-48f0-8bd3-1e97e9728e05 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:33.961480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 150/297] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:33.966923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:33.969438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15439-5357-4420-b1d8-177a21ac6ef3 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:33.969761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15439-5357-4420-b1d8-177a21ac6ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:33.970045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c15439-5357-4420-b1d8-177a21ac6ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:33.991866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e2c15439-5357-4420-b1d8-177a21ac6ef3 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:33.993429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e2c15439-5357-4420-b1d8-177a21ac6ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:34.053537 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7e7360-a597-4e22-abe1-bba2a32ce6ea None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.067502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 151/298] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:34.069119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6615-2673-4a45-af69-327e1a1d6b2d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.069474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6615-2673-4a45-af69-327e1a1d6b2d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.069812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b6615-2673-4a45-af69-327e1a1d6b2d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.071497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 152/299] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:34.077261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026505-33d2-44f6-b880-64cb5f3cc85e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.077550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026505-33d2-44f6-b880-64cb5f3cc85e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.077832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23026505-33d2-44f6-b880-64cb5f3cc85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.095123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-23026505-33d2-44f6-b880-64cb5f3cc85e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:34.095769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ae17-6841-463c-bef4-7abc6e3eb576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.096340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-23026505-33d2-44f6-b880-64cb5f3cc85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:34.096580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ae17-6841-463c-bef4-7abc6e3eb576 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.096854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ae17-6841-463c-bef4-7abc6e3eb576 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.097132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122ae17-6841-463c-bef4-7abc6e3eb576 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.108675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122ae17-6841-463c-bef4-7abc6e3eb576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-2122ae17-6841-463c-bef4-7abc6e3eb576 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:34.116217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:34.117107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:34.117905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 148/300] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:34.119528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ae17-6841-463c-bef4-7abc6e3eb576 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.169561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 153/301] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:34.170249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23026505-33d2-44f6-b880-64cb5f3cc85e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.214596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:34.226653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:34.229504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122ae17-6841-463c-bef4-7abc6e3eb576 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.266460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93591820-68b4-4195-af07-890aa44dfb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.267284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93591820-68b4-4195-af07-890aa44dfb60 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.267571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93591820-68b4-4195-af07-890aa44dfb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.267878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93591820-68b4-4195-af07-890aa44dfb60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.277689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23026505-33d2-44f6-b880-64cb5f3cc85e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.278261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93591820-68b4-4195-af07-890aa44dfb60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-93591820-68b4-4195-af07-890aa44dfb60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:34.286103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:34.287187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:34.288193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:34.292241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 149/302] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:34.292988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93591820-68b4-4195-af07-890aa44dfb60 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.316604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.317408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.317697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.317975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.318748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:34.319072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:34.320545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:34.329307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 154/303] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:34.330119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.403270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93591820-68b4-4195-af07-890aa44dfb60 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.439755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35491-5732-4ac0-83e7-a4d3f9b8a1e0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.442053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:34.444379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68110fb6-76a4-40eb-ac5f-0e405ac9d522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.445200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68110fb6-76a4-40eb-ac5f-0e405ac9d522 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.445472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68110fb6-76a4-40eb-ac5f-0e405ac9d522 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.445746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68110fb6-76a4-40eb-ac5f-0e405ac9d522 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.446935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68110fb6-76a4-40eb-ac5f-0e405ac9d522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:34.448844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68110fb6-76a4-40eb-ac5f-0e405ac9d522 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:34.451300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 150/304] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:34.452003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68110fb6-76a4-40eb-ac5f-0e405ac9d522 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.475080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.475789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.476334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.476334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.477096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:34.477394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:34.478794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:34.483713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:34.487534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 155/305] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:34.492692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.559678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68110fb6-76a4-40eb-ac5f-0e405ac9d522 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.595018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d2f3c-dfbc-4dc3-ad9b-839c8eb20e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.595933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d2f3c-dfbc-4dc3-ad9b-839c8eb20e31 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.596217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d2f3c-dfbc-4dc3-ad9b-839c8eb20e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.596510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d2f3c-dfbc-4dc3-ad9b-839c8eb20e31 None admin] PATH_INFO: `/v3/users/bbfbbde382554904be7a2f5e1664c6c6` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.600370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eb9d08-134a-47c7-a0fb-5aede4e2e935 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.614304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d2f3c-dfbc-4dc3-ad9b-839c8eb20e31 None admin] RBAC: Authorizing `identity:get_user(user_id=bbfbbde382554904be7a2f5e1664c6c6)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:34.615832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d2f3c-dfbc-4dc3-ad9b-839c8eb20e31 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:34.617728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 151/306] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:34 2022] GET /identity/v3/users/bbfbbde382554904be7a2f5e1664c6c6 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:34.623102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d2f3c-dfbc-4dc3-ad9b-839c8eb20e31 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.635917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a83817-61c7-439d-a8b1-48ae4cccaf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.636632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a83817-61c7-439d-a8b1-48ae4cccaf52 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.636912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a83817-61c7-439d-a8b1-48ae4cccaf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.637175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a83817-61c7-439d-a8b1-48ae4cccaf52 None admin] PATH_INFO: `/v3/groups` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.637998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a83817-61c7-439d-a8b1-48ae4cccaf52 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:34.639406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a83817-61c7-439d-a8b1-48ae4cccaf52 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:34.667802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 156/307] 10.222.0.64 () {60 vars in 1134 bytes} [Tue Jul 12 13:27:34 2022] POST /identity/v3/groups => generated 229 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:34.668890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a83817-61c7-439d-a8b1-48ae4cccaf52 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.713115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:34.740229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:34.760993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d2f3c-dfbc-4dc3-ad9b-839c8eb20e31 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.798618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabecb28-6352-4617-a9a0-5cd49a4fd657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.800440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabecb28-6352-4617-a9a0-5cd49a4fd657 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.800947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabecb28-6352-4617-a9a0-5cd49a4fd657 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.801417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabecb28-6352-4617-a9a0-5cd49a4fd657 None admin] PATH_INFO: `/v3/users/1fb5b12b7ba54500aee2f94e07b55fca` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.803033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabecb28-6352-4617-a9a0-5cd49a4fd657 None admin] RBAC: Authorizing `identity:get_user(user_id=1fb5b12b7ba54500aee2f94e07b55fca)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:34.804826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabecb28-6352-4617-a9a0-5cd49a4fd657 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:34.806120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a83817-61c7-439d-a8b1-48ae4cccaf52 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.807041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 152/308] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:34 2022] GET /identity/v3/users/1fb5b12b7ba54500aee2f94e07b55fca => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:34.813333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabecb28-6352-4617-a9a0-5cd49a4fd657 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:34.848423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d4d87-73c4-4203-95b2-84a2c83b8898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.849404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4d87-73c4-4203-95b2-84a2c83b8898 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.849689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4d87-73c4-4203-95b2-84a2c83b8898 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.849978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d4d87-73c4-4203-95b2-84a2c83b8898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.850814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d4d87-73c4-4203-95b2-84a2c83b8898 None admin] RBAC: Adding query filter params (role.id=c61c0210f997401eb1ea6dc7bbdcfe25, user.id=bbfbbde382554904be7a2f5e1664c6c6, scope.system=all) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:34.851647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d4d87-73c4-4203-95b2-84a2c83b8898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:34.852611 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2d4d87-73c4-4203-95b2-84a2c83b8898 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:34.860826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 157/309] 10.222.0.64 () {56 vars in 1308 bytes} [Tue Jul 12 13:27:34 2022] GET /identity/v3/role_assignments?user.id=bbfbbde382554904be7a2f5e1664c6c6&scope.system=all&role.id=c61c0210f997401eb1ea6dc7bbdcfe25 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:34.909689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e8c7-7c63-47c1-a5f8-5234fbd6ecaf None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.910318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e8c7-7c63-47c1-a5f8-5234fbd6ecaf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.910318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19e8c7-7c63-47c1-a5f8-5234fbd6ecaf None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.912117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 158/310] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:34.917441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb51fe-1595-4045-96bd-50378690bbee None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.917730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb51fe-1595-4045-96bd-50378690bbee None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.918015 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb51fe-1595-4045-96bd-50378690bbee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.933819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabecb28-6352-4617-a9a0-5cd49a4fd657 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:34.945581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f3eb51fe-1595-4045-96bd-50378690bbee None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:34.947347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f3eb51fe-1595-4045-96bd-50378690bbee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:34.976667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933e8c2-d019-4368-a3ed-39291afc5f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:34.977577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e8c2-d019-4368-a3ed-39291afc5f73 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:34.977922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e8c2-d019-4368-a3ed-39291afc5f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:34.978275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933e8c2-d019-4368-a3ed-39291afc5f73 None admin] PATH_INFO: `/v3/system/users/1fb5b12b7ba54500aee2f94e07b55fca/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:34.980066 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933e8c2-d019-4368-a3ed-39291afc5f73 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1fb5b12b7ba54500aee2f94e07b55fca, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:34.981710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2933e8c2-d019-4368-a3ed-39291afc5f73 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:34.995173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 153/311] 10.222.0.64 () {58 vars in 1334 bytes} [Tue Jul 12 13:27:34 2022] PUT /identity/v3/system/users/1fb5b12b7ba54500aee2f94e07b55fca/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:35.037831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 159/312] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:35.061388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933e8c2-d019-4368-a3ed-39291afc5f73 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:35.087879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:35.182707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933e8c2-d019-4368-a3ed-39291afc5f73 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:35.218906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf65b3-dcd4-4104-b3ce-95114d67de45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:35.219737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf65b3-dcd4-4104-b3ce-95114d67de45 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:35.220024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf65b3-dcd4-4104-b3ce-95114d67de45 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:35.220299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf65b3-dcd4-4104-b3ce-95114d67de45 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:35.231828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bf65b3-dcd4-4104-b3ce-95114d67de45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-60bf65b3-dcd4-4104-b3ce-95114d67de45 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:35.239370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:35.240279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:35.241421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 154/313] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:35.246423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb51fe-1595-4045-96bd-50378690bbee None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:35.267171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:35.347953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb51fe-1595-4045-96bd-50378690bbee None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:35.381793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:35.382486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:35.382764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:35.383037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:35.383824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:35.384130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:35.385512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:35.394317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 160/314] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:35.399449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf65b3-dcd4-4104-b3ce-95114d67de45 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:35.482860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:35.505586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf65b3-dcd4-4104-b3ce-95114d67de45 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:35.541901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a27e-cd7c-42ce-858f-85a58c417482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:35.542794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a27e-cd7c-42ce-858f-85a58c417482 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:35.543074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a27e-cd7c-42ce-858f-85a58c417482 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:35.543349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20a27e-cd7c-42ce-858f-85a58c417482 None admin] PATH_INFO: `/v3/users/3ec85bfda2e74900b9d9efd63d7043e8` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:35.544616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20a27e-cd7c-42ce-858f-85a58c417482 None admin] RBAC: Authorizing `identity:get_user(user_id=3ec85bfda2e74900b9d9efd63d7043e8)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:35.546081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20a27e-cd7c-42ce-858f-85a58c417482 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:35.548031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 155/315] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:35 2022] GET /identity/v3/users/3ec85bfda2e74900b9d9efd63d7043e8 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:35.553588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:35.637460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:35.659621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c80018-98ae-439c-86f3-9823fec5b548 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:35.689816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe418a1-4b3f-4569-ad6c-458a6d79ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:35.690651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe418a1-4b3f-4569-ad6c-458a6d79ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:35.690931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe418a1-4b3f-4569-ad6c-458a6d79ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:35.691206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe418a1-4b3f-4569-ad6c-458a6d79ddd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:35.757694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe418a1-4b3f-4569-ad6c-458a6d79ddd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:35.759101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe418a1-4b3f-4569-ad6c-458a6d79ddd5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:35.844814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:35.867879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 161/316] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:35.869465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a27e-cd7c-42ce-858f-85a58c417482 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:35.973133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20a27e-cd7c-42ce-858f-85a58c417482 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:36.009077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0bd4dc-d251-418a-bb11-4dd16ce72dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:36.009871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd4dc-d251-418a-bb11-4dd16ce72dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:36.010154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd4dc-d251-418a-bb11-4dd16ce72dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:36.010428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0bd4dc-d251-418a-bb11-4dd16ce72dc6 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:36.011635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bd4dc-d251-418a-bb11-4dd16ce72dc6 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:36.013155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0bd4dc-d251-418a-bb11-4dd16ce72dc6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:36.014878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 156/317] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:35 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:36.020737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe418a1-4b3f-4569-ad6c-458a6d79ddd5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:36.118603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe418a1-4b3f-4569-ad6c-458a6d79ddd5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:36.152570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa13b1ea-4016-4e8b-ba41-1d64baf67d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:36.153234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b1ea-4016-4e8b-ba41-1d64baf67d4b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:36.153544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b1ea-4016-4e8b-ba41-1d64baf67d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:36.153820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13b1ea-4016-4e8b-ba41-1d64baf67d4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:36.154661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13b1ea-4016-4e8b-ba41-1d64baf67d4b None admin] RBAC: Adding query filter params (role.id=c61c0210f997401eb1ea6dc7bbdcfe25, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc, user.id=3ec85bfda2e74900b9d9efd63d7043e8) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:36.154974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13b1ea-4016-4e8b-ba41-1d64baf67d4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:36.156453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa13b1ea-4016-4e8b-ba41-1d64baf67d4b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:36.163049 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 162/318] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:27:36 2022] GET /identity/v3/role_assignments?user.id=3ec85bfda2e74900b9d9efd63d7043e8&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=c61c0210f997401eb1ea6dc7bbdcfe25 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:36.866603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476552a-2478-40d0-aa98-e32d8446db2d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:36.866856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476552a-2478-40d0-aa98-e32d8446db2d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:36.867119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476552a-2478-40d0-aa98-e32d8446db2d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:36.868690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 157/319] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:36.874018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a9236-a44b-4695-a988-01d28ae8d090 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:36.874286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a9236-a44b-4695-a988-01d28ae8d090 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:36.874616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a9236-a44b-4695-a988-01d28ae8d090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:36.892191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c93a9236-a44b-4695-a988-01d28ae8d090 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:36.893418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c93a9236-a44b-4695-a988-01d28ae8d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:36.906642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18a0e4-b5df-41c8-ba7f-dedad0fcd6d4 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:36.907135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18a0e4-b5df-41c8-ba7f-dedad0fcd6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:36.907416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18a0e4-b5df-41c8-ba7f-dedad0fcd6d4 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:36.909128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 158/320] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:36.913940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901242d1-1512-4468-ba27-464926ab1e20 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:36.914244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901242d1-1512-4468-ba27-464926ab1e20 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:36.914703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901242d1-1512-4468-ba27-464926ab1e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:36.932771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-901242d1-1512-4468-ba27-464926ab1e20 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:36.933983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-901242d1-1512-4468-ba27-464926ab1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:36.942064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:36.944877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:36.970510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 163/321] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:36.993287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a9236-a44b-4695-a988-01d28ae8d090 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.009581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 159/322] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:37.031861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901242d1-1512-4468-ba27-464926ab1e20 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.094910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a9236-a44b-4695-a988-01d28ae8d090 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.127964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c5d2d-bf17-4adc-a6ca-eba8d68f1b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.128779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c5d2d-bf17-4adc-a6ca-eba8d68f1b38 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.129066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c5d2d-bf17-4adc-a6ca-eba8d68f1b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.129343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c5d2d-bf17-4adc-a6ca-eba8d68f1b38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.130556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c5d2d-bf17-4adc-a6ca-eba8d68f1b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:37.132035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c5d2d-bf17-4adc-a6ca-eba8d68f1b38 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:37.132468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901242d1-1512-4468-ba27-464926ab1e20 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.133667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 164/323] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:37.134826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f4c4-1875-4bac-add8-b708b2e78ee0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.135115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f4c4-1875-4bac-add8-b708b2e78ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.135390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f4c4-1875-4bac-add8-b708b2e78ee0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.136633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 165/324] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:37.139838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f4c4-1875-4bac-add8-b708b2e78ee0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.171806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae433a4-c846-4cfe-9c10-7c29ea36ec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.172552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae433a4-c846-4cfe-9c10-7c29ea36ec28 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.172836 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae433a4-c846-4cfe-9c10-7c29ea36ec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.173712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae433a4-c846-4cfe-9c10-7c29ea36ec28 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.183047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae433a4-c846-4cfe-9c10-7c29ea36ec28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:37.183937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-eae433a4-c846-4cfe-9c10-7c29ea36ec28 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:37.191226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:37.192247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:37.193043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 160/325] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:37.194024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fbac2-7141-42b2-a9a0-cfac4dc25732 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.194310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fbac2-7141-42b2-a9a0-cfac4dc25732 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.194585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fbac2-7141-42b2-a9a0-cfac4dc25732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.200297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:37.211851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e40fbac2-7141-42b2-a9a0-cfac4dc25732 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:37.213054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e40fbac2-7141-42b2-a9a0-cfac4dc25732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:37.254415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42f4c4-1875-4bac-add8-b708b2e78ee0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.278154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 161/326] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:37.279100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fbac2-7141-42b2-a9a0-cfac4dc25732 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.290195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba223e5-7f78-467b-ad77-14e219a9fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.290953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba223e5-7f78-467b-ad77-14e219a9fb0e None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.291303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba223e5-7f78-467b-ad77-14e219a9fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.291697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba223e5-7f78-467b-ad77-14e219a9fb0e None admin] PATH_INFO: `/v3/groups` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.292418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba223e5-7f78-467b-ad77-14e219a9fb0e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:37.293864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba223e5-7f78-467b-ad77-14e219a9fb0e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:37.308542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 166/327] 10.222.0.64 () {60 vars in 1134 bytes} [Tue Jul 12 13:27:37 2022] POST /identity/v3/groups => generated 226 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:27:37.309837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba223e5-7f78-467b-ad77-14e219a9fb0e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.419566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fbac2-7141-42b2-a9a0-cfac4dc25732 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.422278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba223e5-7f78-467b-ad77-14e219a9fb0e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.425536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:37.458130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.458818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.459095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.459360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.460142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:37.460447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:37.461828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:37.463442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:37.470393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b9ce8-5607-4355-b35f-838a261673fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.471310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b9ce8-5607-4355-b35f-838a261673fb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.471593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b9ce8-5607-4355-b35f-838a261673fb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.471898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b9ce8-5607-4355-b35f-838a261673fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.472423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 162/328] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:37.478007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.484396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b9ce8-5607-4355-b35f-838a261673fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-102b9ce8-5607-4355-b35f-838a261673fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:37.492215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:37.493120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:37.493888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 167/329] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:37.499407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b9ce8-5607-4355-b35f-838a261673fb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.596823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98512881-a4f0-4e21-83ea-843fc9de9301 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.630630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b9ce8-5607-4355-b35f-838a261673fb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.635362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aed8e-8f3b-45b7-9b02-ad5bc8e9ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.636478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aed8e-8f3b-45b7-9b02-ad5bc8e9ab80 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.636902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aed8e-8f3b-45b7-9b02-ad5bc8e9ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.637314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aed8e-8f3b-45b7-9b02-ad5bc8e9ab80 None admin] PATH_INFO: `/v3/users/bbfbbde382554904be7a2f5e1664c6c6` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.638819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aed8e-8f3b-45b7-9b02-ad5bc8e9ab80 None admin] RBAC: Authorizing `identity:get_user(user_id=bbfbbde382554904be7a2f5e1664c6c6)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:37.641292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aed8e-8f3b-45b7-9b02-ad5bc8e9ab80 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:37.644194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 163/330] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:37 2022] GET /identity/v3/users/bbfbbde382554904be7a2f5e1664c6c6 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:37.650400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aed8e-8f3b-45b7-9b02-ad5bc8e9ab80 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.687160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.687965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.688574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.688859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.689895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:37.690207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:37.692536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:37.703698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 168/331] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:37.707418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:37.737472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:37.746007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:37.783786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aed8e-8f3b-45b7-9b02-ad5bc8e9ab80 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.830995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f0df-26de-406a-9c15-b71b40634bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.832146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f0df-26de-406a-9c15-b71b40634bb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.832432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f0df-26de-406a-9c15-b71b40634bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.832708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f0df-26de-406a-9c15-b71b40634bb9 None admin] PATH_INFO: `/v3/system/users/bbfbbde382554904be7a2f5e1664c6c6/roles/c61c0210f997401eb1ea6dc7bbdcfe25` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.834675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f0df-26de-406a-9c15-b71b40634bb9 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bbfbbde382554904be7a2f5e1664c6c6, role_id=c61c0210f997401eb1ea6dc7bbdcfe25)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:37.836400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f0df-26de-406a-9c15-b71b40634bb9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:37.841578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a6749-34ae-4d9a-96f9-726f1f207f08 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:37.848848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 164/332] 10.222.0.64 () {58 vars in 1334 bytes} [Tue Jul 12 13:27:37 2022] PUT /identity/v3/system/users/bbfbbde382554904be7a2f5e1664c6c6/roles/c61c0210f997401eb1ea6dc7bbdcfe25 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:37.886743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f01ce-af50-49a7-a27a-081070c51ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:37.888220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f01ce-af50-49a7-a27a-081070c51ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:37.888687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f01ce-af50-49a7-a27a-081070c51ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:37.889122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f01ce-af50-49a7-a27a-081070c51ff6 None admin] PATH_INFO: `/v3/users/1fb5b12b7ba54500aee2f94e07b55fca` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:37.890733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f01ce-af50-49a7-a27a-081070c51ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=1fb5b12b7ba54500aee2f94e07b55fca)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:37.892496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f01ce-af50-49a7-a27a-081070c51ff6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:37.894876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 169/333] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:37 2022] GET /identity/v3/users/1fb5b12b7ba54500aee2f94e07b55fca => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:37.902075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f0df-26de-406a-9c15-b71b40634bb9 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:38.051180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f0df-26de-406a-9c15-b71b40634bb9 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:38.082209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:38.091790 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d88c3-9fff-489f-835a-0783ea8b5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:38.092515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d88c3-9fff-489f-835a-0783ea8b5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:38.093225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d88c3-9fff-489f-835a-0783ea8b5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:38.093884 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d88c3-9fff-489f-835a-0783ea8b5fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:38.094723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d88c3-9fff-489f-835a-0783ea8b5fb7 None admin] RBAC: Adding query filter params (role.id=edb5b1408bc94aefa62e360a44fa0940, user.id=1fb5b12b7ba54500aee2f94e07b55fca, scope.system=all) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:38.095045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d88c3-9fff-489f-835a-0783ea8b5fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:38.096997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d88c3-9fff-489f-835a-0783ea8b5fb7 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:38.113683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 165/334] 10.222.0.64 () {56 vars in 1308 bytes} [Tue Jul 12 13:27:37 2022] GET /identity/v3/role_assignments?user.id=1fb5b12b7ba54500aee2f94e07b55fca&scope.system=all&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 510 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:39.962132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da525a-0dc3-44a4-9565-82da2b0bddba None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:39.962616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da525a-0dc3-44a4-9565-82da2b0bddba None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:39.962616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da525a-0dc3-44a4-9565-82da2b0bddba None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:39.964258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 170/335] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:39.970457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d0cc-4296-4daf-a20d-b66696cf0c3b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:39.970910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d0cc-4296-4daf-a20d-b66696cf0c3b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:39.971096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314d0cc-4296-4daf-a20d-b66696cf0c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:39.996665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f314d0cc-4296-4daf-a20d-b66696cf0c3b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:39.998123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f314d0cc-4296-4daf-a20d-b66696cf0c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:40.033438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348dbc-4334-4376-88c5-b5bb61d097a9 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.033746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348dbc-4334-4376-88c5-b5bb61d097a9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.033999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9348dbc-4334-4376-88c5-b5bb61d097a9 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.035377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 171/336] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:40.054953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc26d7f-a1f3-4368-a5a0-c1665b21e666 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.055267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc26d7f-a1f3-4368-a5a0-c1665b21e666 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.055516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc26d7f-a1f3-4368-a5a0-c1665b21e666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.085098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5bc26d7f-a1f3-4368-a5a0-c1665b21e666 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:40.086304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5bc26d7f-a1f3-4368-a5a0-c1665b21e666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:40.102543 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 166/337] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:40.141168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314d0cc-4296-4daf-a20d-b66696cf0c3b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:40.232581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 172/338] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 13:27:40.296794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc26d7f-a1f3-4368-a5a0-c1665b21e666 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:40.331314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314d0cc-4296-4daf-a20d-b66696cf0c3b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:40.340025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:40.377312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:40.413201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea92ed6-d765-413b-a486-fdd240177438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:40.414037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92ed6-d765-413b-a486-fdd240177438 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.414320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92ed6-d765-413b-a486-fdd240177438 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.414596 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea92ed6-d765-413b-a486-fdd240177438 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.437213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea92ed6-d765-413b-a486-fdd240177438 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-9ea92ed6-d765-413b-a486-fdd240177438 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:40.453712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:40.454635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:40.455929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 167/339] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:40.466338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc26d7f-a1f3-4368-a5a0-c1665b21e666 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:40.468576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea92ed6-d765-413b-a486-fdd240177438 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:40.514366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e30c-a7c5-49a0-9bc4-1f66f0fac318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:40.515144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e30c-a7c5-49a0-9bc4-1f66f0fac318 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.515465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e30c-a7c5-49a0-9bc4-1f66f0fac318 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.515796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094e30c-a7c5-49a0-9bc4-1f66f0fac318 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.529020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094e30c-a7c5-49a0-9bc4-1f66f0fac318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-3094e30c-a7c5-49a0-9bc4-1f66f0fac318 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:40.536892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:40.537810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:40.539053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 173/340] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:40.544382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e30c-a7c5-49a0-9bc4-1f66f0fac318 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:40.631959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:40.654213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094e30c-a7c5-49a0-9bc4-1f66f0fac318 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:40.654330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea92ed6-d765-413b-a486-fdd240177438 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:40.691767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345164c-42f6-4fd4-87b4-43d54c01ca47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:40.692450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345164c-42f6-4fd4-87b4-43d54c01ca47 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.692734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345164c-42f6-4fd4-87b4-43d54c01ca47 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.693013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345164c-42f6-4fd4-87b4-43d54c01ca47 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.693782 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345164c-42f6-4fd4-87b4-43d54c01ca47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:40.694091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345164c-42f6-4fd4-87b4-43d54c01ca47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:40.695481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345164c-42f6-4fd4-87b4-43d54c01ca47 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:40.705260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 174/341] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:40.711950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3b25e-b7ca-4e7c-8a32-168437070702 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.712269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3b25e-b7ca-4e7c-8a32-168437070702 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.712559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3b25e-b7ca-4e7c-8a32-168437070702 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.714203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 175/342] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:40.715220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3b25e-b7ca-4e7c-8a32-168437070702 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:40.717073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af10f3-9c31-4137-a2d8-0ffbbfc0bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:40.717768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af10f3-9c31-4137-a2d8-0ffbbfc0bab4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.718053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af10f3-9c31-4137-a2d8-0ffbbfc0bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.718333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af10f3-9c31-4137-a2d8-0ffbbfc0bab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.719100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af10f3-9c31-4137-a2d8-0ffbbfc0bab4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:40.719410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af10f3-9c31-4137-a2d8-0ffbbfc0bab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:40.720828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af10f3-9c31-4137-a2d8-0ffbbfc0bab4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:40.744154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 168/343] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:40.745469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06bc2-388d-405f-aac4-c7057b3845c2 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.745764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06bc2-388d-405f-aac4-c7057b3845c2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.746046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b06bc2-388d-405f-aac4-c7057b3845c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.774191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-26b06bc2-388d-405f-aac4-c7057b3845c2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:40.775316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-26b06bc2-388d-405f-aac4-c7057b3845c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:40.823199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3b25e-b7ca-4e7c-8a32-168437070702 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:40.834335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:40.862707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2d396-510c-4815-a3b2-5bee625414df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:40.863425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d396-510c-4815-a3b2-5bee625414df None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:40.863763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d396-510c-4815-a3b2-5bee625414df None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:40.864053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2d396-510c-4815-a3b2-5bee625414df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:40.883755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:40.902400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 169/344] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:40.903376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b06bc2-388d-405f-aac4-c7057b3845c2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:40.946263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2d396-510c-4815-a3b2-5bee625414df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:40.947834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2d396-510c-4815-a3b2-5bee625414df None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:41.054460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 176/345] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:41.055176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2d396-510c-4815-a3b2-5bee625414df None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:41.097582 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b06bc2-388d-405f-aac4-c7057b3845c2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:41.112640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:41.167908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2d396-510c-4815-a3b2-5bee625414df None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:41.205532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ecfe6-ae10-47b1-9f8c-7378dc4d4967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:41.206711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ecfe6-ae10-47b1-9f8c-7378dc4d4967 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.206997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ecfe6-ae10-47b1-9f8c-7378dc4d4967 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.207357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ecfe6-ae10-47b1-9f8c-7378dc4d4967 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.213449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086f798-8259-4f91-a10c-5348513811d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:41.214352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086f798-8259-4f91-a10c-5348513811d9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.214640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086f798-8259-4f91-a10c-5348513811d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.214916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086f798-8259-4f91-a10c-5348513811d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.219456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ecfe6-ae10-47b1-9f8c-7378dc4d4967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-239ecfe6-ae10-47b1-9f8c-7378dc4d4967 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:41.229361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:41.231089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:41.232812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 177/346] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:41.233727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ecfe6-ae10-47b1-9f8c-7378dc4d4967 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:41.260316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:41.305002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086f798-8259-4f91-a10c-5348513811d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:41.306850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086f798-8259-4f91-a10c-5348513811d9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:41.376749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ecfe6-ae10-47b1-9f8c-7378dc4d4967 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:41.384903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:41.425212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f17cc-0a0c-48bf-8507-2d5806324f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:41.426390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f17cc-0a0c-48bf-8507-2d5806324f70 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.426889 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f17cc-0a0c-48bf-8507-2d5806324f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.427073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f17cc-0a0c-48bf-8507-2d5806324f70 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.429270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f17cc-0a0c-48bf-8507-2d5806324f70 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:41.429691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 170/347] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:41.431150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ec38-0c40-4525-a473-dbf4b6add2aa None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.431449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ec38-0c40-4525-a473-dbf4b6add2aa None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.432241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4ec38-0c40-4525-a473-dbf4b6add2aa None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.432812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f17cc-0a0c-48bf-8507-2d5806324f70 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:41.433527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 171/348] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:41.434583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4ec38-0c40-4525-a473-dbf4b6add2aa None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:41.437439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 178/349] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:41 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:41.439870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898278df-81c2-49d0-a9d9-c310ea0fa704 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.440385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898278df-81c2-49d0-a9d9-c310ea0fa704 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.440857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898278df-81c2-49d0-a9d9-c310ea0fa704 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.442606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 179/350] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:41.444351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307e39-dbaf-4cdf-9164-439da786dc74 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.444864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307e39-dbaf-4cdf-9164-439da786dc74 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.451641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54307e39-dbaf-4cdf-9164-439da786dc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.469108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-54307e39-dbaf-4cdf-9164-439da786dc74 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:41.471359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-54307e39-dbaf-4cdf-9164-439da786dc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:41.517013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:41.562500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4ec38-0c40-4525-a473-dbf4b6add2aa None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:41.567813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 180/351] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:41.577039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c671-dbaf-481f-bbf7-61687debe726 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.577326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c671-dbaf-481f-bbf7-61687debe726 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.577605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff5c671-dbaf-481f-bbf7-61687debe726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.605967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:41.607058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.607459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2ff5c671-dbaf-481f-bbf7-61687debe726 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:41.607754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.608215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.608864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2ff5c671-dbaf-481f-bbf7-61687debe726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:41.609630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:41.610123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:41.612034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:41.621389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 172/352] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:41.622147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:41.700252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 181/353] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:41.701115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c671-dbaf-481f-bbf7-61687debe726 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:41.749097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:41.763776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52198ecc-34f2-4f7f-b0d5-c440a0ef1e57 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:41.799145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:41.804253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2b577-7f06-40ff-9a46-6e04b778bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:41.805217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b577-7f06-40ff-9a46-6e04b778bf91 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.805505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b577-7f06-40ff-9a46-6e04b778bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.806167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b577-7f06-40ff-9a46-6e04b778bf91 None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.815382 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2b577-7f06-40ff-9a46-6e04b778bf91 None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:41.816969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2b577-7f06-40ff-9a46-6e04b778bf91 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:41.818882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 173/354] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:41 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:41.819663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2b577-7f06-40ff-9a46-6e04b778bf91 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:41.827125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff5c671-dbaf-481f-bbf7-61687debe726 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:41.866982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96473ca5-f062-4c6e-9594-61e9b664670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:41.867901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96473ca5-f062-4c6e-9594-61e9b664670a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.868177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96473ca5-f062-4c6e-9594-61e9b664670a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.868449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96473ca5-f062-4c6e-9594-61e9b664670a None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:41.870948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96473ca5-f062-4c6e-9594-61e9b664670a None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:41.872081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96473ca5-f062-4c6e-9594-61e9b664670a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:41.874217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 182/355] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:41 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:41.875011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96473ca5-f062-4c6e-9594-61e9b664670a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:41.955435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2b577-7f06-40ff-9a46-6e04b778bf91 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:41.993174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b088b-04a5-40e5-88f7-e759c0c0d19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:41.993996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b088b-04a5-40e5-88f7-e759c0c0d19d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:41.994273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b088b-04a5-40e5-88f7-e759c0c0d19d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:41.994540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b088b-04a5-40e5-88f7-e759c0c0d19d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.008219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b088b-04a5-40e5-88f7-e759c0c0d19d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:42.010720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96473ca5-f062-4c6e-9594-61e9b664670a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.013147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-397b088b-04a5-40e5-88f7-e759c0c0d19d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:42.016435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:42.017383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:42.018232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 174/356] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:42.019394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b088b-04a5-40e5-88f7-e759c0c0d19d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.055459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c008f7-6fc5-4d28-a327-83b6d2b337e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.056439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c008f7-6fc5-4d28-a327-83b6d2b337e8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.056723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c008f7-6fc5-4d28-a327-83b6d2b337e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.056999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c008f7-6fc5-4d28-a327-83b6d2b337e8 None admin] PATH_INFO: `/v3/users/bbfbbde382554904be7a2f5e1664c6c6` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.058874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c008f7-6fc5-4d28-a327-83b6d2b337e8 None admin] RBAC: Authorizing `identity:get_user(user_id=bbfbbde382554904be7a2f5e1664c6c6)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:42.060732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c008f7-6fc5-4d28-a327-83b6d2b337e8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:42.062389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 183/357] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:27:41 2022] GET /identity/v3/users/bbfbbde382554904be7a2f5e1664c6c6 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:42.063151 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c008f7-6fc5-4d28-a327-83b6d2b337e8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.090395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:42.145738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b088b-04a5-40e5-88f7-e759c0c0d19d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.180312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c008f7-6fc5-4d28-a327-83b6d2b337e8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.190200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259440b-49fb-43c1-96c0-66ec4ab9a3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.192001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259440b-49fb-43c1-96c0-66ec4ab9a3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.192001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259440b-49fb-43c1-96c0-66ec4ab9a3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.192001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259440b-49fb-43c1-96c0-66ec4ab9a3f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.204339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a259440b-49fb-43c1-96c0-66ec4ab9a3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a259440b-49fb-43c1-96c0-66ec4ab9a3f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:42.212327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:42.213249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:42.214089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 175/358] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:42.214775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259440b-49fb-43c1-96c0-66ec4ab9a3f9 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.225171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.225849 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.226124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.226401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.227242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] RBAC: Adding query filter params (group.id=477a09b2a15b4442b10f821fa63c5b41, role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=db1c690ced93499dab8ca839563bf7f0) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:42.227557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:42.229505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:42.235549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 184/359] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/role_assignments?group.id=477a09b2a15b4442b10f821fa63c5b41&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:42.236372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.287006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:42.372153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259440b-49fb-43c1-96c0-66ec4ab9a3f9 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.382127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042cf0b-2de6-4eea-9ab7-667e40018340 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.390607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:42.419856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b97f0d-871f-4287-9299-b6070f4633d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.420739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97f0d-871f-4287-9299-b6070f4633d9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.421103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97f0d-871f-4287-9299-b6070f4633d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.421297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b97f0d-871f-4287-9299-b6070f4633d9 None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.424386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97f0d-871f-4287-9299-b6070f4633d9 None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:42.425144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b97f0d-871f-4287-9299-b6070f4633d9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:42.425332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.426021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.426302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.426573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.426813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 176/360] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:42.427328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:42.428636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c49a0-25b9-409a-ab0a-27e28a5b2c0b None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.428636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c49a0-25b9-409a-ab0a-27e28a5b2c0b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.428636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c49a0-25b9-409a-ab0a-27e28a5b2c0b None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.429957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 177/361] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:42.434015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c49a0-25b9-409a-ab0a-27e28a5b2c0b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.434539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:42.434539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:42.445674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 185/362] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:42.446351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.557038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:42.567455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eec3e8-5ab0-45c6-a1f2-e034a0aa75f6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.572640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c49a0-25b9-409a-ab0a-27e28a5b2c0b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.612713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91425eb1-2b62-42ef-b068-90694dff366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.613584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425eb1-2b62-42ef-b068-90694dff366d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.613702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425eb1-2b62-42ef-b068-90694dff366d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.614551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91425eb1-2b62-42ef-b068-90694dff366d None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.614722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91425eb1-2b62-42ef-b068-90694dff366d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:42.614981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91425eb1-2b62-42ef-b068-90694dff366d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:42.616582 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91425eb1-2b62-42ef-b068-90694dff366d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:42.621539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.622298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.622534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.622813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.627161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] RBAC: Adding query filter params (role.id=c61c0210f997401eb1ea6dc7bbdcfe25, user.id=bbfbbde382554904be7a2f5e1664c6c6, scope.system=all) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:42.627161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:42.627161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:42.632159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 186/363] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:42.633512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11edf-2758-4bce-9449-627455f70592 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.633803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11edf-2758-4bce-9449-627455f70592 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.634158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11edf-2758-4bce-9449-627455f70592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.644871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 178/364] 10.222.0.64 () {56 vars in 1308 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/role_assignments?user.id=bbfbbde382554904be7a2f5e1664c6c6&scope.system=all&role.id=c61c0210f997401eb1ea6dc7bbdcfe25 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:42.646052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.664217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-54a11edf-2758-4bce-9449-627455f70592 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:42.665188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-54a11edf-2758-4bce-9449-627455f70592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:42.706489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:42.757898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 187/365] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:42.758739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a11edf-2758-4bce-9449-627455f70592 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.816823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b4df3-125e-4a66-98ea-a041ceea5adb None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.864295 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.864954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.865234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.865505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:42.866402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] RBAC: Adding query filter params (group.id=477a09b2a15b4442b10f821fa63c5b41, role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=db1c690ced93499dab8ca839563bf7f0) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:42.866811 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:42.868378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:42.873157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:42.878274 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 179/366] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/role_assignments?group.id=477a09b2a15b4442b10f821fa63c5b41&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=f473c53d5223450d931d5e666473c86b => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:42.879186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:42.893924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a11edf-2758-4bce-9449-627455f70592 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:42.947181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049c021-6dd0-4841-9f95-3d6b1739e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:42.948788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049c021-6dd0-4841-9f95-3d6b1739e101 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:42.948788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049c021-6dd0-4841-9f95-3d6b1739e101 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:42.948788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049c021-6dd0-4841-9f95-3d6b1739e101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.026523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb459ef9-efcf-4528-92f1-a571f7e43268 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.032524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:43.040889 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049c021-6dd0-4841-9f95-3d6b1739e101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.043414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049c021-6dd0-4841-9f95-3d6b1739e101 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.079145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264dd1-cee7-46c7-84a7-49625a4802a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.079870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264dd1-cee7-46c7-84a7-49625a4802a0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.080157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264dd1-cee7-46c7-84a7-49625a4802a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.080433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35264dd1-cee7-46c7-84a7-49625a4802a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.160669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35264dd1-cee7-46c7-84a7-49625a4802a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.162285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:43.164063 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35264dd1-cee7-46c7-84a7-49625a4802a0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.176334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 188/367] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:43.177267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049c021-6dd0-4841-9f95-3d6b1739e101 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:43.271247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 180/368] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:43.275623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264dd1-cee7-46c7-84a7-49625a4802a0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:43.281219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:43.282256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049c021-6dd0-4841-9f95-3d6b1739e101 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.321770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942d027-f11c-4f6c-af40-5cfca263c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.322898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d027-f11c-4f6c-af40-5cfca263c308 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.323410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d027-f11c-4f6c-af40-5cfca263c308 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.323917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942d027-f11c-4f6c-af40-5cfca263c308 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.336273 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942d027-f11c-4f6c-af40-5cfca263c308 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7942d027-f11c-4f6c-af40-5cfca263c308 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:43.346060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:43.346961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:43.347778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:43.350604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 189/369] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:43.351763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942d027-f11c-4f6c-af40-5cfca263c308 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:43.387837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35264dd1-cee7-46c7-84a7-49625a4802a0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.410128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:43.426057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b53ab-1b3f-4e28-91e2-d08a127244db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.426857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b53ab-1b3f-4e28-91e2-d08a127244db None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.427142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b53ab-1b3f-4e28-91e2-d08a127244db None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.427419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b53ab-1b3f-4e28-91e2-d08a127244db None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.429990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b53ab-1b3f-4e28-91e2-d08a127244db None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.432557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b53ab-1b3f-4e28-91e2-d08a127244db None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.433596 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 181/370] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:43.434781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b53ab-1b3f-4e28-91e2-d08a127244db None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:43.464022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942d027-f11c-4f6c-af40-5cfca263c308 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.510348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7cd3f-6846-4996-bddb-1add3b3190ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.511230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7cd3f-6846-4996-bddb-1add3b3190ef None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.511515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7cd3f-6846-4996-bddb-1add3b3190ef None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.511837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a7cd3f-6846-4996-bddb-1add3b3190ef None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.513191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7cd3f-6846-4996-bddb-1add3b3190ef None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.514650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a7cd3f-6846-4996-bddb-1add3b3190ef None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.516735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 190/371] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:43.517516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7cd3f-6846-4996-bddb-1add3b3190ef None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:43.522572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:43.561959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b53ab-1b3f-4e28-91e2-d08a127244db None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.605375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.606361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.606803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.607290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.608262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:43.609222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.611153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.622620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 182/372] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:43.624006 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:43.635799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a7cd3f-6846-4996-bddb-1add3b3190ef None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.654428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:43.673559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47cd63-d6bc-4595-b9ac-dda85c7fca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.674486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47cd63-d6bc-4595-b9ac-dda85c7fca9b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.674768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47cd63-d6bc-4595-b9ac-dda85c7fca9b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.675051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47cd63-d6bc-4595-b9ac-dda85c7fca9b None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.676302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47cd63-d6bc-4595-b9ac-dda85c7fca9b None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.677765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47cd63-d6bc-4595-b9ac-dda85c7fca9b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.679546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 191/373] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:43.681373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47cd63-d6bc-4595-b9ac-dda85c7fca9b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:43.736419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fa81-0739-4d5a-ac75-3248270688de None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.771237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059826d-4be4-4eff-8037-539bb7fa5bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.772502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059826d-4be4-4eff-8037-539bb7fa5bec None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.772991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059826d-4be4-4eff-8037-539bb7fa5bec None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.773469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059826d-4be4-4eff-8037-539bb7fa5bec None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.774859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059826d-4be4-4eff-8037-539bb7fa5bec None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.776541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059826d-4be4-4eff-8037-539bb7fa5bec None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.778746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 183/374] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:43.779708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059826d-4be4-4eff-8037-539bb7fa5bec None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:43.789686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:43.795506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47cd63-d6bc-4595-b9ac-dda85c7fca9b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.830793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b1442-ab36-4374-9552-8efabb265215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.831826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1442-ab36-4374-9552-8efabb265215 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.832307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1442-ab36-4374-9552-8efabb265215 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.832809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b1442-ab36-4374-9552-8efabb265215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.887803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:43.895068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059826d-4be4-4eff-8037-539bb7fa5bec None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:43.905327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b1442-ab36-4374-9552-8efabb265215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.907069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b1442-ab36-4374-9552-8efabb265215 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.930856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34637752-2b41-4f28-a485-621cb642373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:43.931441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637752-2b41-4f28-a485-621cb642373d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:43.931801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637752-2b41-4f28-a485-621cb642373d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:43.932116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34637752-2b41-4f28-a485-621cb642373d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:43.932953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34637752-2b41-4f28-a485-621cb642373d None admin] RBAC: Adding query filter params (group.id=477a09b2a15b4442b10f821fa63c5b41, role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:43.933262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34637752-2b41-4f28-a485-621cb642373d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:43.935173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34637752-2b41-4f28-a485-621cb642373d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:43.941359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 184/375] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/role_assignments?group.id=477a09b2a15b4442b10f821fa63c5b41&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:43.942237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34637752-2b41-4f28-a485-621cb642373d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:44.013125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:44.017830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 192/376] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:44.023206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b1442-ab36-4374-9552-8efabb265215 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:44.051638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34637752-2b41-4f28-a485-621cb642373d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:44.088838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:44.089516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:44.089791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:44.090091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:44.091243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] RBAC: Adding query filter params (group.id=477a09b2a15b4442b10f821fa63c5b41, role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:44.091839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:44.093087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:44.099640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 185/377] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:43 2022] GET /identity/v3/role_assignments?group.id=477a09b2a15b4442b10f821fa63c5b41&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=f473c53d5223450d931d5e666473c86b => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:44.131031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:44.144328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b1442-ab36-4374-9552-8efabb265215 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:44.191292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782518a-de17-4034-92f8-f10aeba27988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:44.192147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782518a-de17-4034-92f8-f10aeba27988 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:44.192433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782518a-de17-4034-92f8-f10aeba27988 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:44.192707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5782518a-de17-4034-92f8-f10aeba27988 None admin] PATH_INFO: `/v3/projects/0d8758be35b84eb491917415afdbf67c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:44.193930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782518a-de17-4034-92f8-f10aeba27988 None admin] RBAC: Authorizing `identity:get_project(project_id=0d8758be35b84eb491917415afdbf67c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:44.195394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5782518a-de17-4034-92f8-f10aeba27988 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:44.197517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 193/378] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:44 2022] GET /identity/v3/projects/0d8758be35b84eb491917415afdbf67c => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:44.203211 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:44.331012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc441f32-1e82-4604-a525-f1a3572dce14 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:44.367414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:44.375206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f75eb-3d06-404b-b323-a9b524e19355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:44.376125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f75eb-3d06-404b-b323-a9b524e19355 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:44.376412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f75eb-3d06-404b-b323-a9b524e19355 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:44.376689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f75eb-3d06-404b-b323-a9b524e19355 None admin] PATH_INFO: `/v3/groups/c1aa19584f1949dea96df56956fa8604` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:44.388280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f75eb-3d06-404b-b323-a9b524e19355 None admin] RBAC: Authorizing `identity:get_group(group_id=c1aa19584f1949dea96df56956fa8604)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:44.389764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f75eb-3d06-404b-b323-a9b524e19355 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:44.391747 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 186/379] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:44 2022] GET /identity/v3/groups/c1aa19584f1949dea96df56956fa8604 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:44.397266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782518a-de17-4034-92f8-f10aeba27988 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:44.521287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5782518a-de17-4034-92f8-f10aeba27988 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:44.562761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c1fa3-1ddf-4a94-b718-41fdbd6f28a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:44.563557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1fa3-1ddf-4a94-b718-41fdbd6f28a3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:44.563866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1fa3-1ddf-4a94-b718-41fdbd6f28a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:44.564145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1fa3-1ddf-4a94-b718-41fdbd6f28a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:44.564996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c1fa3-1ddf-4a94-b718-41fdbd6f28a3 None admin] RBAC: Adding query filter params (group.id=c1aa19584f1949dea96df56956fa8604, role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=0d8758be35b84eb491917415afdbf67c) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:44.565312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c1fa3-1ddf-4a94-b718-41fdbd6f28a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:44.566749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c1fa3-1ddf-4a94-b718-41fdbd6f28a3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:44.573125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 194/380] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:44 2022] GET /identity/v3/role_assignments?group.id=c1aa19584f1949dea96df56956fa8604&scope.project.id=0d8758be35b84eb491917415afdbf67c&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:44.723390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004555-b70f-4f5f-87eb-f09b8df9aa46 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:44.723739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004555-b70f-4f5f-87eb-f09b8df9aa46 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:44.724052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004555-b70f-4f5f-87eb-f09b8df9aa46 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:44.725808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 187/381] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:44.737239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd68d-ec58-4135-90af-5deef789f1c1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:44.737867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd68d-ec58-4135-90af-5deef789f1c1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:44.738336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd68d-ec58-4135-90af-5deef789f1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:44.764768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3c3dd68d-ec58-4135-90af-5deef789f1c1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:44.766342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3c3dd68d-ec58-4135-90af-5deef789f1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:44.779371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:44.847203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 195/382] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:44.883541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d004555-b70f-4f5f-87eb-f09b8df9aa46 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:45.013922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d004555-b70f-4f5f-87eb-f09b8df9aa46 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:45.060130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408e3d5-8f1d-4715-8cfb-7c613c8c6b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:45.060867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408e3d5-8f1d-4715-8cfb-7c613c8c6b8c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:45.061148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408e3d5-8f1d-4715-8cfb-7c613c8c6b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:45.061420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408e3d5-8f1d-4715-8cfb-7c613c8c6b8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:45.078720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408e3d5-8f1d-4715-8cfb-7c613c8c6b8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f408e3d5-8f1d-4715-8cfb-7c613c8c6b8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:45.086341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:45.087236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:45.088098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:45.091732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 188/383] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:45.094061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dd68d-ec58-4135-90af-5deef789f1c1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:45.212734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dd68d-ec58-4135-90af-5deef789f1c1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:45.257312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec52dfe-8ba6-4dd6-96df-44f0b94c2fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:45.257994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52dfe-8ba6-4dd6-96df-44f0b94c2fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:45.258273 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52dfe-8ba6-4dd6-96df-44f0b94c2fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:45.258548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec52dfe-8ba6-4dd6-96df-44f0b94c2fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:45.259297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec52dfe-8ba6-4dd6-96df-44f0b94c2fb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:45.259611 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec52dfe-8ba6-4dd6-96df-44f0b94c2fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:45.260992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec52dfe-8ba6-4dd6-96df-44f0b94c2fb3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:45.275011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 196/384] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:45.280795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408e3d5-8f1d-4715-8cfb-7c613c8c6b8c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:45.349251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:45.401982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408e3d5-8f1d-4715-8cfb-7c613c8c6b8c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:45.424358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb145f-8140-4245-b135-d47d3b977a4c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:45.424689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb145f-8140-4245-b135-d47d3b977a4c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:45.424905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adb145f-8140-4245-b135-d47d3b977a4c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:45.426543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 197/385] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:45.434064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07648a5-87dc-4c07-8a04-a870d4221b53 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:45.434741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07648a5-87dc-4c07-8a04-a870d4221b53 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:45.435016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07648a5-87dc-4c07-8a04-a870d4221b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:45.453157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf6eb-723d-488a-99a5-d474e1fd7947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:45.454026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf6eb-723d-488a-99a5-d474e1fd7947 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:45.454303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf6eb-723d-488a-99a5-d474e1fd7947 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:45.454570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bf6eb-723d-488a-99a5-d474e1fd7947 None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:45.455785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf6eb-723d-488a-99a5-d474e1fd7947 None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:45.457327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bf6eb-723d-488a-99a5-d474e1fd7947 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:45.463458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 189/386] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:45 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:45.464595 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d07648a5-87dc-4c07-8a04-a870d4221b53 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:45.464709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf6eb-723d-488a-99a5-d474e1fd7947 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:45.465853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d07648a5-87dc-4c07-8a04-a870d4221b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:45.468132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:45.598440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 198/387] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:45.618224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bf6eb-723d-488a-99a5-d474e1fd7947 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:45.632334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07648a5-87dc-4c07-8a04-a870d4221b53 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:45.658506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:45.683223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5a196-a994-4f7f-9c62-6ac4ba9d6848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:45.684438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5a196-a994-4f7f-9c62-6ac4ba9d6848 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:45.684808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5a196-a994-4f7f-9c62-6ac4ba9d6848 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:45.685083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5a196-a994-4f7f-9c62-6ac4ba9d6848 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:45.694703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5a196-a994-4f7f-9c62-6ac4ba9d6848 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:45.696248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5a196-a994-4f7f-9c62-6ac4ba9d6848 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:45.698283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 190/388] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:45 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:45.703670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5a196-a994-4f7f-9c62-6ac4ba9d6848 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:45.813356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07648a5-87dc-4c07-8a04-a870d4221b53 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:45.879931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9d283-10b7-417d-a8e1-a097b4ddc489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:45.880695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d283-10b7-417d-a8e1-a097b4ddc489 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:45.881139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d283-10b7-417d-a8e1-a097b4ddc489 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:45.881580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9d283-10b7-417d-a8e1-a097b4ddc489 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:45.889889 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:45.894367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9d283-10b7-417d-a8e1-a097b4ddc489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:45.901130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5a196-a994-4f7f-9c62-6ac4ba9d6848 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-12c9d283-10b7-417d-a8e1-a097b4ddc489 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:45.905301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:45.906353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:45.907324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:45.910399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 199/389] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:45.919831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9d283-10b7-417d-a8e1-a097b4ddc489 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:45.964155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d40f72-cc59-4661-937b-2ac11d534e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:45.965045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40f72-cc59-4661-937b-2ac11d534e9e None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:45.965324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40f72-cc59-4661-937b-2ac11d534e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:45.965657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d40f72-cc59-4661-937b-2ac11d534e9e None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0/groups/477a09b2a15b4442b10f821fa63c5b41/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:45.969853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d40f72-cc59-4661-937b-2ac11d534e9e None admin] RBAC: Authorizing `identity:create_grant(project_id=db1c690ced93499dab8ca839563bf7f0, group_id=477a09b2a15b4442b10f821fa63c5b41, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:45.971295 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d40f72-cc59-4661-937b-2ac11d534e9e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:45.999765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 191/390] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 12 13:27:45 2022] PUT /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0/groups/477a09b2a15b4442b10f821fa63c5b41/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:27:46.076863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9d283-10b7-417d-a8e1-a097b4ddc489 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:46.122590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:46.123271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.123546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.123839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.124594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:46.124895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:46.126297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:46.138580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 200/391] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:46.143446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d40f72-cc59-4661-937b-2ac11d534e9e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:46.201581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:46.251582 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d40f72-cc59-4661-937b-2ac11d534e9e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:46.286866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113fe8f4-f178-48f7-a32e-79beda98ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:46.287804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fe8f4-f178-48f7-a32e-79beda98ad44 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.288083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fe8f4-f178-48f7-a32e-79beda98ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.288352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113fe8f4-f178-48f7-a32e-79beda98ad44 None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.289561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fe8f4-f178-48f7-a32e-79beda98ad44 None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:46.291125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113fe8f4-f178-48f7-a32e-79beda98ad44 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:46.296594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 192/392] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:46 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:46.299025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:46.382657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:46.434035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cd13e-962f-4422-9374-34f2c84e88ce None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:46.472682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bdc87-219c-427e-946d-f47354ef4759 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.472995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bdc87-219c-427e-946d-f47354ef4759 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.473843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bdc87-219c-427e-946d-f47354ef4759 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.478654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 193/393] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:46.482480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6637f1-65ea-492e-981c-7f8fe5a99067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:46.483646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6637f1-65ea-492e-981c-7f8fe5a99067 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.484130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6637f1-65ea-492e-981c-7f8fe5a99067 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.484608 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6637f1-65ea-492e-981c-7f8fe5a99067 None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.488431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6637f1-65ea-492e-981c-7f8fe5a99067 None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:46.490113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6637f1-65ea-492e-981c-7f8fe5a99067 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:46.492343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 201/394] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:46 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:46.493503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974801a-e700-4459-9963-d816e0d003d0 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.493798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974801a-e700-4459-9963-d816e0d003d0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.494076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974801a-e700-4459-9963-d816e0d003d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.497455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6637f1-65ea-492e-981c-7f8fe5a99067 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:46.527118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3974801a-e700-4459-9963-d816e0d003d0 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:46.528476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3974801a-e700-4459-9963-d816e0d003d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:46.599202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6637f1-65ea-492e-981c-7f8fe5a99067 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:46.625634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:46.638884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006efc-f773-4450-b53f-588d2437800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:46.639926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006efc-f773-4450-b53f-588d2437800f None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.640213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006efc-f773-4450-b53f-588d2437800f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.640494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006efc-f773-4450-b53f-588d2437800f None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0/groups/477a09b2a15b4442b10f821fa63c5b41/roles/f473c53d5223450d931d5e666473c86b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.642892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006efc-f773-4450-b53f-588d2437800f None admin] RBAC: Authorizing `identity:create_grant(project_id=db1c690ced93499dab8ca839563bf7f0, group_id=477a09b2a15b4442b10f821fa63c5b41, role_id=f473c53d5223450d931d5e666473c86b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:46.644506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b006efc-f773-4450-b53f-588d2437800f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:46.655305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 194/395] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:46.657933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6e93-3bda-4f94-802f-7686440e15ee None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.658448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6e93-3bda-4f94-802f-7686440e15ee None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.658932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f6e93-3bda-4f94-802f-7686440e15ee None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.660759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 195/396] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:46.666480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c736eb6-3673-41a1-8945-9f6faf975b37 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.667154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c736eb6-3673-41a1-8945-9f6faf975b37 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.667746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c736eb6-3673-41a1-8945-9f6faf975b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.670030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 202/397] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 12 13:27:46 2022] PUT /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0/groups/477a09b2a15b4442b10f821fa63c5b41/roles/f473c53d5223450d931d5e666473c86b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:27:46.687561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3c736eb6-3673-41a1-8945-9f6faf975b37 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:46.688143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006efc-f773-4450-b53f-588d2437800f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:46.689421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3c736eb6-3673-41a1-8945-9f6faf975b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:46.756028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:46.800733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 196/398] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:46.834809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c736eb6-3673-41a1-8945-9f6faf975b37 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:46.851576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b006efc-f773-4450-b53f-588d2437800f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:46.900751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2ade0-d7b7-4a3b-88de-d622734174f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:46.901630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ade0-d7b7-4a3b-88de-d622734174f3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:46.901905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ade0-d7b7-4a3b-88de-d622734174f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:46.902239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2ade0-d7b7-4a3b-88de-d622734174f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:46.913869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2ade0-d7b7-4a3b-88de-d622734174f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-69e2ade0-d7b7-4a3b-88de-d622734174f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:46.925524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:46.926463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:46.927290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:46.930556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 203/399] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:46.933453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2ade0-d7b7-4a3b-88de-d622734174f3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:46.969686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c736eb6-3673-41a1-8945-9f6faf975b37 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:46.988873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:47.015907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ae67-8ef3-43ff-9c08-d925e95c05c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.016725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ae67-8ef3-43ff-9c08-d925e95c05c3 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.017007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ae67-8ef3-43ff-9c08-d925e95c05c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.017621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389ae67-8ef3-43ff-9c08-d925e95c05c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.031019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389ae67-8ef3-43ff-9c08-d925e95c05c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:47.038762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2ade0-d7b7-4a3b-88de-d622734174f3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-4389ae67-8ef3-43ff-9c08-d925e95c05c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:47.040580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:47.042618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:47.044609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 197/400] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:47.049207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ae67-8ef3-43ff-9c08-d925e95c05c3 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:47.095034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:47.160314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.161007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.161283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.161558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.162327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:47.162630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:47.164034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:47.164318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389ae67-8ef3-43ff-9c08-d925e95c05c3 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:47.183248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 204/401] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:47.188962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:47.202618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.203506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.203831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.204104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.204955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] RBAC: Adding query filter params (name=member) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:47.205263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:47.206644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:47.216781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 198/402] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:47.222254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:47.339090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:47.344718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db975240-baa3-465a-8028-2d5daa2ecb76 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:47.382454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734631-61cb-4256-b816-34c577d92573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.383566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734631-61cb-4256-b816-34c577d92573 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.384035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734631-61cb-4256-b816-34c577d92573 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.384942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734631-61cb-4256-b816-34c577d92573 None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.386427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89734631-61cb-4256-b816-34c577d92573 None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:47.388106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89734631-61cb-4256-b816-34c577d92573 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:47.390300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 199/403] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:47 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:47.396934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734631-61cb-4256-b816-34c577d92573 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:47.425565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d89d0-a573-48b1-9244-156618a2df48 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:47.441726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:47.479238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f9580-d99e-4f62-b37d-18ad8d7d07dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.480072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f9580-d99e-4f62-b37d-18ad8d7d07dd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.480357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f9580-d99e-4f62-b37d-18ad8d7d07dd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.480636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f9580-d99e-4f62-b37d-18ad8d7d07dd None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.482449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f9580-d99e-4f62-b37d-18ad8d7d07dd None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:47.484252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f9580-d99e-4f62-b37d-18ad8d7d07dd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:47.487251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 205/404] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:47 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:47.488822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031289-ba8e-4cda-8866-a321765e34a4 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.489111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031289-ba8e-4cda-8866-a321765e34a4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.489387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52031289-ba8e-4cda-8866-a321765e34a4 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.490854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 206/405] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:47.494516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52031289-ba8e-4cda-8866-a321765e34a4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:47.540528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734631-61cb-4256-b816-34c577d92573 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:47.580253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaf6af-0196-4b3e-8f0b-e32eff19e2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.581178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaf6af-0196-4b3e-8f0b-e32eff19e2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.581457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaf6af-0196-4b3e-8f0b-e32eff19e2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.581735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaf6af-0196-4b3e-8f0b-e32eff19e2b8 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.582983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaf6af-0196-4b3e-8f0b-e32eff19e2b8 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:47.584525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaf6af-0196-4b3e-8f0b-e32eff19e2b8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:47.591330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 200/406] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:47 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:47.592720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0cd9-d8bd-49df-b938-85fa28fbcd1a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.593016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0cd9-d8bd-49df-b938-85fa28fbcd1a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.593295 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d0cd9-d8bd-49df-b938-85fa28fbcd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.610725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-aa8d0cd9-d8bd-49df-b938-85fa28fbcd1a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:47.611869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-aa8d0cd9-d8bd-49df-b938-85fa28fbcd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:47.631231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52031289-ba8e-4cda-8866-a321765e34a4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:47.644547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:47.680639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c83c82-2629-4164-998c-7ca865d70e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.682055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c83c82-2629-4164-998c-7ca865d70e41 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.682921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c83c82-2629-4164-998c-7ca865d70e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.683642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c83c82-2629-4164-998c-7ca865d70e41 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.685487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c83c82-2629-4164-998c-7ca865d70e41 None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:47.687202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c83c82-2629-4164-998c-7ca865d70e41 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:47.692822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 201/407] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:47.692822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d0cd9-d8bd-49df-b938-85fa28fbcd1a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:47.693338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 207/408] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:47 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:47.700000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c83c82-2629-4164-998c-7ca865d70e41 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:47.763857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:47.807265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d0cd9-d8bd-49df-b938-85fa28fbcd1a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:47.821117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c83c82-2629-4164-998c-7ca865d70e41 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:47.842299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1981ecf-5320-483b-8557-b312a12c5e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.843726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1981ecf-5320-483b-8557-b312a12c5e07 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.844043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1981ecf-5320-483b-8557-b312a12c5e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.844323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1981ecf-5320-483b-8557-b312a12c5e07 None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/groups/477a09b2a15b4442b10f821fa63c5b41/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.846305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1981ecf-5320-483b-8557-b312a12c5e07 None admin] RBAC: Authorizing `identity:create_grant(project_id=ac06e348b2a54d158a10b3bd54365fbc, group_id=477a09b2a15b4442b10f821fa63c5b41, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:47.847866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1981ecf-5320-483b-8557-b312a12c5e07 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:47.860744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda823-2927-42be-82e4-a02189500aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:47.861948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda823-2927-42be-82e4-a02189500aad None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:47.862484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda823-2927-42be-82e4-a02189500aad None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:47.862968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda823-2927-42be-82e4-a02189500aad None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/groups/477a09b2a15b4442b10f821fa63c5b41/roles/f473c53d5223450d931d5e666473c86b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:47.864635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 202/409] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 12 13:27:47 2022] PUT /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/groups/477a09b2a15b4442b10f821fa63c5b41/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:47.868286 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1981ecf-5320-483b-8557-b312a12c5e07 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:47.872852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcda823-2927-42be-82e4-a02189500aad None admin] RBAC: Authorizing `identity:create_grant(project_id=ac06e348b2a54d158a10b3bd54365fbc, group_id=477a09b2a15b4442b10f821fa63c5b41, role_id=f473c53d5223450d931d5e666473c86b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:47.875100 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcda823-2927-42be-82e4-a02189500aad None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:47.902284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 208/410] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 12 13:27:47 2022] PUT /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc/groups/477a09b2a15b4442b10f821fa63c5b41/roles/f473c53d5223450d931d5e666473c86b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:47.928431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:48.037531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1981ecf-5320-483b-8557-b312a12c5e07 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.078806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e458710-2a52-44f7-8b9a-03f8bd006d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.079671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e458710-2a52-44f7-8b9a-03f8bd006d22 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.079959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e458710-2a52-44f7-8b9a-03f8bd006d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.080235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e458710-2a52-44f7-8b9a-03f8bd006d22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.092335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e458710-2a52-44f7-8b9a-03f8bd006d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-0e458710-2a52-44f7-8b9a-03f8bd006d22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:48.100268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:48.101231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:48.102008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 203/411] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:48.108087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda823-2927-42be-82e4-a02189500aad None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:48.236207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda823-2927-42be-82e4-a02189500aad None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.243330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:48.270860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.271538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.271842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.272159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.272914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:48.273218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:48.274614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:48.287766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 209/412] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:48.292695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e458710-2a52-44f7-8b9a-03f8bd006d22 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:48.420857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:48.427646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e458710-2a52-44f7-8b9a-03f8bd006d22 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.463636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccd16a-5fdb-4132-bfe4-d5ebdaa7a94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.464511 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccd16a-5fdb-4132-bfe4-d5ebdaa7a94b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.464796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccd16a-5fdb-4132-bfe4-d5ebdaa7a94b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.465073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccd16a-5fdb-4132-bfe4-d5ebdaa7a94b None admin] PATH_INFO: `/v3/groups/c1aa19584f1949dea96df56956fa8604` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.466337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccd16a-5fdb-4132-bfe4-d5ebdaa7a94b None admin] RBAC: Authorizing `identity:get_group(group_id=c1aa19584f1949dea96df56956fa8604)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:48.467815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccd16a-5fdb-4132-bfe4-d5ebdaa7a94b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:48.469785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 204/413] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:48 2022] GET /identity/v3/groups/c1aa19584f1949dea96df56956fa8604 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:48.475131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:48.476999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e185-01cf-4553-a652-c93d865b4a8c None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.477291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e185-01cf-4553-a652-c93d865b4a8c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.477570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff8e185-01cf-4553-a652-c93d865b4a8c None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.478886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 205/414] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:48.484734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be2914-2e14-4d2f-bf0d-a55176bd18d2 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.485030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be2914-2e14-4d2f-bf0d-a55176bd18d2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.485310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be2914-2e14-4d2f-bf0d-a55176bd18d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.512697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-29be2914-2e14-4d2f-bf0d-a55176bd18d2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:48.515433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-29be2914-2e14-4d2f-bf0d-a55176bd18d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:48.633812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5f820-5915-4ddd-8ef6-56381499e86b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.646009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 206/415] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:48.695564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0eab3-091f-45ae-bbaa-84282cde1f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.696494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0eab3-091f-45ae-bbaa-84282cde1f58 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.696783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0eab3-091f-45ae-bbaa-84282cde1f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.697065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0eab3-091f-45ae-bbaa-84282cde1f58 None admin] PATH_INFO: `/v3/projects/0d8758be35b84eb491917415afdbf67c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.698286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0eab3-091f-45ae-bbaa-84282cde1f58 None admin] RBAC: Authorizing `identity:get_project(project_id=0d8758be35b84eb491917415afdbf67c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:48.699791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0eab3-091f-45ae-bbaa-84282cde1f58 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:48.701935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 210/416] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:48 2022] GET /identity/v3/projects/0d8758be35b84eb491917415afdbf67c => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:48.705241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be2914-2e14-4d2f-bf0d-a55176bd18d2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:48.716977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0eab3-091f-45ae-bbaa-84282cde1f58 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:48.795956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:48.869002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:48.898085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be2914-2e14-4d2f-bf0d-a55176bd18d2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.920169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0eab3-091f-45ae-bbaa-84282cde1f58 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:48.961187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941754-5544-4b1e-8019-74d03a3f5620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.962008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941754-5544-4b1e-8019-74d03a3f5620 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.962288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941754-5544-4b1e-8019-74d03a3f5620 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.962559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f941754-5544-4b1e-8019-74d03a3f5620 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.981293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977c640-de27-4609-861f-96152a08c217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:48.982198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977c640-de27-4609-861f-96152a08c217 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:48.982479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977c640-de27-4609-861f-96152a08c217 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:48.982751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977c640-de27-4609-861f-96152a08c217 None admin] PATH_INFO: `/v3/projects/0d8758be35b84eb491917415afdbf67c/groups/c1aa19584f1949dea96df56956fa8604/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:48.984842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f941754-5544-4b1e-8019-74d03a3f5620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:48.992465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977c640-de27-4609-861f-96152a08c217 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d8758be35b84eb491917415afdbf67c, group_id=c1aa19584f1949dea96df56956fa8604, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:48.994263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c977c640-de27-4609-861f-96152a08c217 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-8f941754-5544-4b1e-8019-74d03a3f5620 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:49.002393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:49.003487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:49.004509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:49.006891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 207/417] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:49.016019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941754-5544-4b1e-8019-74d03a3f5620 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:49.019339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 211/418] 10.222.0.64 () {58 vars in 1442 bytes} [Tue Jul 12 13:27:48 2022] PUT /identity/v3/projects/0d8758be35b84eb491917415afdbf67c/groups/c1aa19584f1949dea96df56956fa8604/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:27:49.133818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f941754-5544-4b1e-8019-74d03a3f5620 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:49.175455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2210a00-e966-49f0-9b03-e6b7c00ce2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:49.176084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210a00-e966-49f0-9b03-e6b7c00ce2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:49.176372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210a00-e966-49f0-9b03-e6b7c00ce2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:49.176643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2210a00-e966-49f0-9b03-e6b7c00ce2a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:49.177411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2210a00-e966-49f0-9b03-e6b7c00ce2a5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:49.177715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2210a00-e966-49f0-9b03-e6b7c00ce2a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:49.179104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2210a00-e966-49f0-9b03-e6b7c00ce2a5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:49.189272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 208/419] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:49.195091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977c640-de27-4609-861f-96152a08c217 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:49.295423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97337242-9819-4bb7-8c0e-2aa683451850 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:49.296091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97337242-9819-4bb7-8c0e-2aa683451850 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:49.296567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97337242-9819-4bb7-8c0e-2aa683451850 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:49.298749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 209/420] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:49.304559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c452-9b36-4c3a-b308-59b3cd14e8a7 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:49.305126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c452-9b36-4c3a-b308-59b3cd14e8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:49.305606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537c452-9b36-4c3a-b308-59b3cd14e8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:49.324194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:49.331544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:49.332898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d537c452-9b36-4c3a-b308-59b3cd14e8a7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:49.335283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d537c452-9b36-4c3a-b308-59b3cd14e8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:49.342009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c977c640-de27-4609-861f-96152a08c217 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:49.385930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3193c-bb1e-4ca3-abf1-c36ed6e94012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:49.386601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3193c-bb1e-4ca3-abf1-c36ed6e94012 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:49.387067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3193c-bb1e-4ca3-abf1-c36ed6e94012 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:49.387542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3193c-bb1e-4ca3-abf1-c36ed6e94012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:49.431495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 210/421] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:49.457063 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c452-9b36-4c3a-b308-59b3cd14e8a7 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:49.476157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3193c-bb1e-4ca3-abf1-c36ed6e94012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:49.477741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3193c-bb1e-4ca3-abf1-c36ed6e94012 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:49.596335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537c452-9b36-4c3a-b308-59b3cd14e8a7 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:49.663932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b3186-2e73-4c6e-97f5-19697b3eefa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:49.663932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b3186-2e73-4c6e-97f5-19697b3eefa4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:49.663932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b3186-2e73-4c6e-97f5-19697b3eefa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:49.663932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b3186-2e73-4c6e-97f5-19697b3eefa4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:49.667865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:49.668131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 212/422] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:49.668453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:49.674492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3193c-bb1e-4ca3-abf1-c36ed6e94012 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:49.687050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b3186-2e73-4c6e-97f5-19697b3eefa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-301b3186-2e73-4c6e-97f5-19697b3eefa4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:49.697974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:49.698856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:49.699729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:49.701029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 211/423] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:49.708282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b3186-2e73-4c6e-97f5-19697b3eefa4 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:49.843082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3193c-bb1e-4ca3-abf1-c36ed6e94012 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:49.883585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b3186-2e73-4c6e-97f5-19697b3eefa4 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:49.903209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee392b1-8b85-4f69-a5d2-3bd5ed5a12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:49.904117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee392b1-8b85-4f69-a5d2-3bd5ed5a12ec None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:49.904396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee392b1-8b85-4f69-a5d2-3bd5ed5a12ec None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:49.904666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee392b1-8b85-4f69-a5d2-3bd5ed5a12ec None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:49.907286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee392b1-8b85-4f69-a5d2-3bd5ed5a12ec None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:49.908742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee392b1-8b85-4f69-a5d2-3bd5ed5a12ec None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:49.911821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 213/424] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:49 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:49.919021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee392b1-8b85-4f69-a5d2-3bd5ed5a12ec None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:49.941007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:49.942050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:49.942484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:49.942902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:49.943909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:49.944400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:49.945986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:49.955226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 212/425] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:49.960886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:50.029628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:50.053302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:50.099698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee392b1-8b85-4f69-a5d2-3bd5ed5a12ec None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:50.138324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bd02-1459-45d6-a664-fac9e57ea33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:50.139206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bd02-1459-45d6-a664-fac9e57ea33b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.139483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bd02-1459-45d6-a664-fac9e57ea33b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.139773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0bd02-1459-45d6-a664-fac9e57ea33b None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.144905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bd02-1459-45d6-a664-fac9e57ea33b None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:50.146344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0bd02-1459-45d6-a664-fac9e57ea33b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:50.148023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 214/426] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:49 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:50.153942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361548c5-0e2a-43d0-aa13-af60cbe164eb None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:50.155489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bd02-1459-45d6-a664-fac9e57ea33b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:50.224968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218212f-b997-4d2f-a238-826a9dee19c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:50.225551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218212f-b997-4d2f-a238-826a9dee19c0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.225831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218212f-b997-4d2f-a238-826a9dee19c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.226103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218212f-b997-4d2f-a238-826a9dee19c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.310778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0bd02-1459-45d6-a664-fac9e57ea33b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:50.344871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:50.353199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8399f-ff94-4fb0-bc91-a42d2d4da5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:50.355060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8399f-ff94-4fb0-bc91-a42d2d4da5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.356414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8399f-ff94-4fb0-bc91-a42d2d4da5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.358191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8399f-ff94-4fb0-bc91-a42d2d4da5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.359231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8399f-ff94-4fb0-bc91-a42d2d4da5c6 None admin] RBAC: Adding query filter params (group.id=477a09b2a15b4442b10f821fa63c5b41, role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=db1c690ced93499dab8ca839563bf7f0) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:50.360664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8399f-ff94-4fb0-bc91-a42d2d4da5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:50.362331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8399f-ff94-4fb0-bc91-a42d2d4da5c6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:50.375424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 215/427] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:50 2022] GET /identity/v3/role_assignments?group.id=477a09b2a15b4442b10f821fa63c5b41&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 611 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:50.376341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218212f-b997-4d2f-a238-826a9dee19c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:50.377268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9c0c-aba1-43a3-ba15-84b2ac88b5b8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.377711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9c0c-aba1-43a3-ba15-84b2ac88b5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.377882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218212f-b997-4d2f-a238-826a9dee19c0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:50.378270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9c0c-aba1-43a3-ba15-84b2ac88b5b8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.379891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 216/428] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:50.385848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46384b-6d2e-4234-b911-d21b8e31cb00 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.386388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46384b-6d2e-4234-b911-d21b8e31cb00 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.386807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46384b-6d2e-4234-b911-d21b8e31cb00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.405371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7d46384b-6d2e-4234-b911-d21b8e31cb00 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:50.406953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7d46384b-6d2e-4234-b911-d21b8e31cb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:50.452452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:50.489745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 217/429] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:50.497749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42515ab-a947-42f1-bd28-2f4b73df5b5a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.498371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42515ab-a947-42f1-bd28-2f4b73df5b5a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.498790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42515ab-a947-42f1-bd28-2f4b73df5b5a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.500776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 218/430] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:50.505187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 213/431] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 13:27:50.506252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74235ca-a6d5-4d28-b901-1ab69a1d512c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.506540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74235ca-a6d5-4d28-b901-1ab69a1d512c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.506847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74235ca-a6d5-4d28-b901-1ab69a1d512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.512966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218212f-b997-4d2f-a238-826a9dee19c0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:50.537959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f74235ca-a6d5-4d28-b901-1ab69a1d512c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:50.539298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f74235ca-a6d5-4d28-b901-1ab69a1d512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:50.625824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218212f-b997-4d2f-a238-826a9dee19c0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:50.633769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 219/432] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:50.634373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74235ca-a6d5-4d28-b901-1ab69a1d512c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:50.690604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02586e-b64d-46cf-a2f5-58694c7bbb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:50.692545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02586e-b64d-46cf-a2f5-58694c7bbb7a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.692545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02586e-b64d-46cf-a2f5-58694c7bbb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.692711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02586e-b64d-46cf-a2f5-58694c7bbb7a None admin] PATH_INFO: `/v3/projects/db1c690ced93499dab8ca839563bf7f0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.693936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02586e-b64d-46cf-a2f5-58694c7bbb7a None admin] RBAC: Authorizing `identity:get_project(project_id=db1c690ced93499dab8ca839563bf7f0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:50.695793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02586e-b64d-46cf-a2f5-58694c7bbb7a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:50.698564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 214/433] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:50 2022] GET /identity/v3/projects/db1c690ced93499dab8ca839563bf7f0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:50.699567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02586e-b64d-46cf-a2f5-58694c7bbb7a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:50.708951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:50.729143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:50.763139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74235ca-a6d5-4d28-b901-1ab69a1d512c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:50.810199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba0fcd-aba1-45ec-930a-1af48e4c43a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:50.811124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba0fcd-aba1-45ec-930a-1af48e4c43a2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.811463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba0fcd-aba1-45ec-930a-1af48e4c43a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.811742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba0fcd-aba1-45ec-930a-1af48e4c43a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.828067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba0fcd-aba1-45ec-930a-1af48e4c43a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:50.835926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02586e-b64d-46cf-a2f5-58694c7bbb7a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-69ba0fcd-aba1-45ec-930a-1af48e4c43a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:50.839032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:50.840069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:50.841007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 220/434] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:50.841668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba0fcd-aba1-45ec-930a-1af48e4c43a2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:50.881645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7a429-a86c-4a68-bc2a-074a5b3b51c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:50.881873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a429-a86c-4a68-bc2a-074a5b3b51c5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:50.882377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a429-a86c-4a68-bc2a-074a5b3b51c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:50.882377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7a429-a86c-4a68-bc2a-074a5b3b51c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:50.894616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d7a429-a86c-4a68-bc2a-074a5b3b51c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a5d7a429-a86c-4a68-bc2a-074a5b3b51c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:50.902675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:50.903652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:50.904468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:50.905084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 215/435] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:50.905755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7a429-a86c-4a68-bc2a-074a5b3b51c5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:50.974396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba0fcd-aba1-45ec-930a-1af48e4c43a2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:50.993282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:50.994517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.011206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7a429-a86c-4a68-bc2a-074a5b3b51c5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.016563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af3a53-9651-4fcb-b96c-8abe71804990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.017376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3a53-9651-4fcb-b96c-8abe71804990 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.017659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3a53-9651-4fcb-b96c-8abe71804990 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.017933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af3a53-9651-4fcb-b96c-8abe71804990 None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.019541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af3a53-9651-4fcb-b96c-8abe71804990 None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.021396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af3a53-9651-4fcb-b96c-8abe71804990 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.023425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 221/436] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:50 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:51.024208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af3a53-9651-4fcb-b96c-8abe71804990 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.052243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.052927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.053287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.053489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.054255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:51.054567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.055981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.067976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 216/437] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:51.069620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.132673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af3a53-9651-4fcb-b96c-8abe71804990 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.168241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.168967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.169251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.169697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.170270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:51.170575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.171968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.172375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebbb8c-5f83-45f3-bc82-42896c2e8d9d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.180266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 222/438] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:51.180905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.213715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.214390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.214673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.214941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.215897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] RBAC: Adding query filter params (group.id=477a09b2a15b4442b10f821fa63c5b41, role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=db1c690ced93499dab8ca839563bf7f0) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:51.216192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.217631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.224666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 217/439] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/role_assignments?group.id=477a09b2a15b4442b10f821fa63c5b41&scope.project.id=db1c690ced93499dab8ca839563bf7f0&role.id=f473c53d5223450d931d5e666473c86b => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:51.225283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.234672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.244827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.324633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6103d40-0e7f-4cac-b2f8-05c293a3102e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.362476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f45aef-92f2-42f3-ab26-a8a5583522ee None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.365722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd978a-96c2-4629-8d70-268eab200fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.366473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd978a-96c2-4629-8d70-268eab200fdd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.366754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd978a-96c2-4629-8d70-268eab200fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.367030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd978a-96c2-4629-8d70-268eab200fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.406953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f9239-22ed-4dda-8c95-aa16675b7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.407676 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9239-22ed-4dda-8c95-aa16675b7d1f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.407970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9239-22ed-4dda-8c95-aa16675b7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.408246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f9239-22ed-4dda-8c95-aa16675b7d1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.445548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd978a-96c2-4629-8d70-268eab200fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.447117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd978a-96c2-4629-8d70-268eab200fdd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.484167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f9239-22ed-4dda-8c95-aa16675b7d1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.485392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f9239-22ed-4dda-8c95-aa16675b7d1f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.500577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.502546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.569559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 223/440] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:51.570925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74810be-ab05-4719-bc99-da89ab4a70c0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.571681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74810be-ab05-4719-bc99-da89ab4a70c0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.571681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74810be-ab05-4719-bc99-da89ab4a70c0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.573363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 224/441] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:51.575216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74810be-ab05-4719-bc99-da89ab4a70c0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.611095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 218/442] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:51.612459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782c554-630d-4504-8ea3-0e9873994003 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.612859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782c554-630d-4504-8ea3-0e9873994003 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.613142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0782c554-630d-4504-8ea3-0e9873994003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.629474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0782c554-630d-4504-8ea3-0e9873994003 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:51.630687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0782c554-630d-4504-8ea3-0e9873994003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:51.680105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74810be-ab05-4719-bc99-da89ab4a70c0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.696773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 219/443] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:51.697507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782c554-630d-4504-8ea3-0e9873994003 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.713166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0116d31-8515-4621-bccb-b0a793504a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.714044 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116d31-8515-4621-bccb-b0a793504a6e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.714325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116d31-8515-4621-bccb-b0a793504a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.714599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0116d31-8515-4621-bccb-b0a793504a6e None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.715839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0116d31-8515-4621-bccb-b0a793504a6e None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.717278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0116d31-8515-4621-bccb-b0a793504a6e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.718987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 225/444] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:51.720346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0116d31-8515-4621-bccb-b0a793504a6e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.735037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.744703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.800709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0782c554-630d-4504-8ea3-0e9873994003 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.819696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0116d31-8515-4621-bccb-b0a793504a6e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.834478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e140380-dbdc-4c45-97a0-41b54ac6ff1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.835284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140380-dbdc-4c45-97a0-41b54ac6ff1e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.835565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140380-dbdc-4c45-97a0-41b54ac6ff1e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.835878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e140380-dbdc-4c45-97a0-41b54ac6ff1e None admin] PATH_INFO: `/v3/projects/ac06e348b2a54d158a10b3bd54365fbc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.837085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e140380-dbdc-4c45-97a0-41b54ac6ff1e None admin] RBAC: Authorizing `identity:get_project(project_id=ac06e348b2a54d158a10b3bd54365fbc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.838515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e140380-dbdc-4c45-97a0-41b54ac6ff1e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.840252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 220/445] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/projects/ac06e348b2a54d158a10b3bd54365fbc => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:51.841016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e140380-dbdc-4c45-97a0-41b54ac6ff1e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.856041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cbb90-266a-4bd8-84a4-a99f51a9ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.856982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cbb90-266a-4bd8-84a4-a99f51a9ee2f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.857268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cbb90-266a-4bd8-84a4-a99f51a9ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.857568 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6cbb90-266a-4bd8-84a4-a99f51a9ee2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.868187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6cbb90-266a-4bd8-84a4-a99f51a9ee2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ce6cbb90-266a-4bd8-84a4-a99f51a9ee2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:51.875868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:51.876724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:51.877565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 226/446] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:51.878746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cbb90-266a-4bd8-84a4-a99f51a9ee2f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:51.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e140380-dbdc-4c45-97a0-41b54ac6ff1e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.949047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.951784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:51.973234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6cbb90-266a-4bd8-84a4-a99f51a9ee2f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:51.974429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b8b9-ea33-4b57-b8dd-1027e6a304d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:51.975315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b8b9-ea33-4b57-b8dd-1027e6a304d2 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:51.975616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b8b9-ea33-4b57-b8dd-1027e6a304d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:51.975891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27b8b9-ea33-4b57-b8dd-1027e6a304d2 None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:51.977103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27b8b9-ea33-4b57-b8dd-1027e6a304d2 None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:51.978558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27b8b9-ea33-4b57-b8dd-1027e6a304d2 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:51.980480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 221/447] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:51.981029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b8b9-ea33-4b57-b8dd-1027e6a304d2 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:52.006916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1507b2-c575-45a2-843d-f60941357e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:52.007815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1507b2-c575-45a2-843d-f60941357e28 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:52.008103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1507b2-c575-45a2-843d-f60941357e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:52.008377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1507b2-c575-45a2-843d-f60941357e28 None admin] PATH_INFO: `/v3/groups/477a09b2a15b4442b10f821fa63c5b41` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:52.009555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1507b2-c575-45a2-843d-f60941357e28 None admin] RBAC: Authorizing `identity:get_group(group_id=477a09b2a15b4442b10f821fa63c5b41)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:52.011008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1507b2-c575-45a2-843d-f60941357e28 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:52.012679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 227/448] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/groups/477a09b2a15b4442b10f821fa63c5b41 => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:52.013428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1507b2-c575-45a2-843d-f60941357e28 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:52.083357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27b8b9-ea33-4b57-b8dd-1027e6a304d2 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:52.107866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1507b2-c575-45a2-843d-f60941357e28 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:52.115687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:52.116342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:52.116624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:52.116897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:52.117651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:52.117957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:52.119336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:52.127236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 222/449] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:27:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:52.128035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:52.141974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:52.142633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:52.142911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:52.143183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:52.144059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] RBAC: Adding query filter params (group.id=477a09b2a15b4442b10f821fa63c5b41, role.id=edb5b1408bc94aefa62e360a44fa0940, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:52.144374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:52.145788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:52.151466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 228/450] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:52 2022] GET /identity/v3/role_assignments?group.id=477a09b2a15b4442b10f821fa63c5b41&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=edb5b1408bc94aefa62e360a44fa0940 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:52.152253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:52.170365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:52.176339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:52.241438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c9189-fce5-4ac0-b453-a4e3bfb1eea5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:52.280089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:52.280777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:52.281047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:52.281327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:52.282172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] RBAC: Adding query filter params (group.id=477a09b2a15b4442b10f821fa63c5b41, role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=ac06e348b2a54d158a10b3bd54365fbc) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:52.282489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:52.284004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:52.284716 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bc5dc4-034d-44c3-90c6-c4bcb242b97c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:52.290469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 223/451] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:52 2022] GET /identity/v3/role_assignments?group.id=477a09b2a15b4442b10f821fa63c5b41&scope.project.id=ac06e348b2a54d158a10b3bd54365fbc&role.id=f473c53d5223450d931d5e666473c86b => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:52.331093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884244-f805-4b9d-8566-593d678b0da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:52.331826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884244-f805-4b9d-8566-593d678b0da4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:52.332110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884244-f805-4b9d-8566-593d678b0da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:52.332389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80884244-f805-4b9d-8566-593d678b0da4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:52.410079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80884244-f805-4b9d-8566-593d678b0da4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:52.411478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80884244-f805-4b9d-8566-593d678b0da4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:52.420480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:52.514511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 229/452] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:27:52.520676 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:52.630639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a833f72-73d6-46c9-8ee8-d95a5ad5ca8c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:52.633114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:52.666450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c1cf9-25e1-4aa7-ba64-44f81d381925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:52.667286 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1cf9-25e1-4aa7-ba64-44f81d381925 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:52.667565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1cf9-25e1-4aa7-ba64-44f81d381925 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:52.667880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c1cf9-25e1-4aa7-ba64-44f81d381925 None admin] PATH_INFO: `/v3/projects/0d8758be35b84eb491917415afdbf67c` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:52.669202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c1cf9-25e1-4aa7-ba64-44f81d381925 None admin] RBAC: Authorizing `identity:get_project(project_id=0d8758be35b84eb491917415afdbf67c)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:52.670673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3c1cf9-25e1-4aa7-ba64-44f81d381925 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:52.672504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 224/453] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:27:52 2022] GET /identity/v3/projects/0d8758be35b84eb491917415afdbf67c => generated 344 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:52.678511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884244-f805-4b9d-8566-593d678b0da4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:52.775992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80884244-f805-4b9d-8566-593d678b0da4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:52.783977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:52.816504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb3e13-c880-446a-880f-d984f83e42e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:52.817414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3e13-c880-446a-880f-d984f83e42e0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:52.817703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3e13-c880-446a-880f-d984f83e42e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:52.817987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb3e13-c880-446a-880f-d984f83e42e0 None admin] PATH_INFO: `/v3/groups/c1aa19584f1949dea96df56956fa8604` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:52.819373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb3e13-c880-446a-880f-d984f83e42e0 None admin] RBAC: Authorizing `identity:get_group(group_id=c1aa19584f1949dea96df56956fa8604)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:52.821028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb3e13-c880-446a-880f-d984f83e42e0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:52.822720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 230/454] 10.222.0.64 () {56 vars in 1180 bytes} [Tue Jul 12 13:27:52 2022] GET /identity/v3/groups/c1aa19584f1949dea96df56956fa8604 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:52.829338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c1cf9-25e1-4aa7-ba64-44f81d381925 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:52.942467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c1cf9-25e1-4aa7-ba64-44f81d381925 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:52.980155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f7084-5955-4a27-ac34-80687f82c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:52.980799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7084-5955-4a27-ac34-80687f82c1bc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:52.981085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7084-5955-4a27-ac34-80687f82c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:52.981382 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f7084-5955-4a27-ac34-80687f82c1bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:52.982221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f7084-5955-4a27-ac34-80687f82c1bc None admin] RBAC: Adding query filter params (group.id=c1aa19584f1949dea96df56956fa8604, role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=0d8758be35b84eb491917415afdbf67c) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:52.982532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f7084-5955-4a27-ac34-80687f82c1bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:52.984014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f7084-5955-4a27-ac34-80687f82c1bc None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:52.989992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 225/455] 10.222.0.64 () {56 vars in 1376 bytes} [Tue Jul 12 13:27:52 2022] GET /identity/v3/role_assignments?group.id=c1aa19584f1949dea96df56956fa8604&scope.project.id=0d8758be35b84eb491917415afdbf67c&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:55.415017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084329c-338a-45e8-bf61-0a64feac2ad5 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:55.415911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084329c-338a-45e8-bf61-0a64feac2ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:55.416323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084329c-338a-45e8-bf61-0a64feac2ad5 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:55.418119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 231/456] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:55.423410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416980fd-daf9-473d-9038-dec45e891a0a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:55.424204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416980fd-daf9-473d-9038-dec45e891a0a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:55.424619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416980fd-daf9-473d-9038-dec45e891a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:55.449038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-416980fd-daf9-473d-9038-dec45e891a0a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:55.450601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-416980fd-daf9-473d-9038-dec45e891a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:55.485140 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:55.526314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1512-1481-4410-b175-892df18934ff None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:55.526860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1512-1481-4410-b175-892df18934ff None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:55.527274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e1512-1481-4410-b175-892df18934ff None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:55.529130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 232/457] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:55.534409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 226/458] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:55.537237 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edcaf5-d772-4360-9895-334096b02d63 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:55.537776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edcaf5-d772-4360-9895-334096b02d63 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:55.538252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70edcaf5-d772-4360-9895-334096b02d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:55.555717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-70edcaf5-d772-4360-9895-334096b02d63 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:55.557199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-70edcaf5-d772-4360-9895-334096b02d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:55.573909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416980fd-daf9-473d-9038-dec45e891a0a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:55.666359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 233/459] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:55.698144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c82ab-aec4-410a-bcdd-3f34b388cc7d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:55.698438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c82ab-aec4-410a-bcdd-3f34b388cc7d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:55.698715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c82ab-aec4-410a-bcdd-3f34b388cc7d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:55.700303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 234/460] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:55.709468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c82ab-aec4-410a-bcdd-3f34b388cc7d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:55.730076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416980fd-daf9-473d-9038-dec45e891a0a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:55.765348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf7e0f-4d66-4e41-a069-09267b506ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:55.766161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7e0f-4d66-4e41-a069-09267b506ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:55.766443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7e0f-4d66-4e41-a069-09267b506ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:55.766715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf7e0f-4d66-4e41-a069-09267b506ce2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:55.777552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf7e0f-4d66-4e41-a069-09267b506ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:55.779352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf7e0f-4d66-4e41-a069-09267b506ce2 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-7ccf7e0f-4d66-4e41-a069-09267b506ce2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:27:55.797976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:55.799128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:55.800160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:27:55.800160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:27:55.800160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:55.800160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:55.801970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 227/461] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:55.803430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cfa53-826b-4cef-8902-80ecc6399fa1 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:55.803912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cfa53-826b-4cef-8902-80ecc6399fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:55.804360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cfa53-826b-4cef-8902-80ecc6399fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:55.815628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c82ab-aec4-410a-bcdd-3f34b388cc7d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:55.818143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:55.822485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-555cfa53-826b-4cef-8902-80ecc6399fa1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:55.823721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-555cfa53-826b-4cef-8902-80ecc6399fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:55.837715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:55.853175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:55.854283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:55.854735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:55.855173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:55.866431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:55.868207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:27:55.886449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:55.887364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:55.888428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:27:55.888428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:27:55.888428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:55.888428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:55.890296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 235/462] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:55.891244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:55.901486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 228/463] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:55.902397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cfa53-826b-4cef-8902-80ecc6399fa1 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:55.995452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf94e1-4e67-4a22-a8fe-377bbb085a49 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:56.030086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:56.030330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555cfa53-826b-4cef-8902-80ecc6399fa1 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:56.031130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.031549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.031980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.032942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:56.033420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:56.034918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:56.049391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 236/464] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:56.050991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:56.068413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:56.069163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.069449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.069773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.070519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:56.070829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:56.072370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:56.076426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:56.087743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 229/465] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:56.093087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:56.104580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:56.159387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1fbb1b-b08c-4b76-a000-7ed02dfe35f7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:56.193336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:56.194480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.194956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.195423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.206121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac539e0-a8ab-4fe6-a85b-4cefe38a705e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:56.206725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:56.208401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:27:56.226370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:56.227266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:56.228491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:27:56.228491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:27:56.228491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:56.228491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:56.230424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 237/466] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:56.231443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:56.251565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442fa9-cac5-463b-a0de-c3a8c2424a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:56.252212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442fa9-cac5-463b-a0de-c3a8c2424a10 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.252498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442fa9-cac5-463b-a0de-c3a8c2424a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.252778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33442fa9-cac5-463b-a0de-c3a8c2424a10 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.253753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33442fa9-cac5-463b-a0de-c3a8c2424a10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:56.255777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33442fa9-cac5-463b-a0de-c3a8c2424a10 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:56.282605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 230/467] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:56 2022] POST /identity/v3/users => generated 246 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:56.291639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442fa9-cac5-463b-a0de-c3a8c2424a10 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:56.361883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:56.401488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:56.409881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f299d-ada9-46aa-a51c-0c1ca154414c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:56.451747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4f8c8-d556-4f26-af92-7dd030e939cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:56.452453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4f8c8-d556-4f26-af92-7dd030e939cf None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.453392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4f8c8-d556-4f26-af92-7dd030e939cf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.453392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4f8c8-d556-4f26-af92-7dd030e939cf None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.453712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4f8c8-d556-4f26-af92-7dd030e939cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:56.455186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4f8c8-d556-4f26-af92-7dd030e939cf None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:56.463198 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33442fa9-cac5-463b-a0de-c3a8c2424a10 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:56.477369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 238/468] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:56 2022] POST /identity/v3/users => generated 248 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:56.479174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9af3d-4a8f-4d8c-908d-28c878f1e91a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.479707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9af3d-4a8f-4d8c-908d-28c878f1e91a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.480178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9af3d-4a8f-4d8c-908d-28c878f1e91a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.481791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 239/469] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:56.489170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23756-5536-41b2-a04d-f036c93de486 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.489943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23756-5536-41b2-a04d-f036c93de486 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.490436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd23756-5536-41b2-a04d-f036c93de486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.514083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8fd23756-5536-41b2-a04d-f036c93de486 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:56.516092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8fd23756-5536-41b2-a04d-f036c93de486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:56.517898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:56.518859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.519302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.519767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.520675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:56.521132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:56.522851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:56.541363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 231/470] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:56.550052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:56.605562 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 240/471] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:56.638365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd23756-5536-41b2-a04d-f036c93de486 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:56.697972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df2f14-80b9-4bc6-8e1e-99ee47613f4e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:56.717235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:56.724981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:56.737991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac113523-b735-444b-9bd0-536096ca0e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:56.738690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113523-b735-444b-9bd0-536096ca0e33 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.738971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113523-b735-444b-9bd0-536096ca0e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.740786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac113523-b735-444b-9bd0-536096ca0e33 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.740940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac113523-b735-444b-9bd0-536096ca0e33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:56.745459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac113523-b735-444b-9bd0-536096ca0e33 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:56.770660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 232/472] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:56 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:27:56.783692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd23756-5536-41b2-a04d-f036c93de486 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:56.828074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35008df8-1e82-4b0f-84fb-f61853b16b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:56.829278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008df8-1e82-4b0f-84fb-f61853b16b3b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.829747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008df8-1e82-4b0f-84fb-f61853b16b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.830253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35008df8-1e82-4b0f-84fb-f61853b16b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.842901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35008df8-1e82-4b0f-84fb-f61853b16b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:56.844791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35008df8-1e82-4b0f-84fb-f61853b16b3b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-35008df8-1e82-4b0f-84fb-f61853b16b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:27:56.865360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:56.866387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:56.867216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:27:56.867216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:27:56.867216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:56.867216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:56.874453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 241/473] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:56.876779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac113523-b735-444b-9bd0-536096ca0e33 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:56.950909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00043a-e6d0-44c3-b276-be8cf8f13066 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.951561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00043a-e6d0-44c3-b276-be8cf8f13066 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.952045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d00043a-e6d0-44c3-b276-be8cf8f13066 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.954742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 242/474] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:56.959055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d5c1-7546-4cb5-b57a-4b0feea3e373 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:56.959340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d5c1-7546-4cb5-b57a-4b0feea3e373 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:56.959628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78d5c1-7546-4cb5-b57a-4b0feea3e373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:56.977738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8a78d5c1-7546-4cb5-b57a-4b0feea3e373 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:56.979072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8a78d5c1-7546-4cb5-b57a-4b0feea3e373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:56.998315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac113523-b735-444b-9bd0-536096ca0e33 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:57.040464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:57.041961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:57.042699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:57.043190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:57.044390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:57.045186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:57.047219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:57.056555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 243/475] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:57.063448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 233/476] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:57.068750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d5c1-7546-4cb5-b57a-4b0feea3e373 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:57.082899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:57.119214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:57.135002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:57.187696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78d5c1-7546-4cb5-b57a-4b0feea3e373 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:57.198093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a4a44-fa7a-41b3-88ce-bdc24ea187fc None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:57.224692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c53ad-01a6-41e8-8e43-c5aaee19936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:57.225632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c53ad-01a6-41e8-8e43-c5aaee19936a None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:57.226009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c53ad-01a6-41e8-8e43-c5aaee19936a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:57.226376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c53ad-01a6-41e8-8e43-c5aaee19936a None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:57.227311 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c53ad-01a6-41e8-8e43-c5aaee19936a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:57.228897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c53ad-01a6-41e8-8e43-c5aaee19936a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:57.235015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:57.235978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:57.236405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:57.236820 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:57.237736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:57.239285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:57.246527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.sql.core [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 13:27:57.246527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 13:27:57.246527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [parameters: {'id': '408c1529ed6846ddb06a06b8d12a53d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 13:27:57.246527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80482) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 13:27:57.251839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 244/477] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:27:57 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result.read() Jul 12 13:27:57.265962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:27:57.267078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application yield resource Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise self.value Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application session.commit() Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 13:27:57.268221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.session.flush() Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application compat.raise_( Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 13:27:57.269157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:27:57.270027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result.read() Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:27:57.270837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [parameters: {'id': '408c1529ed6846ddb06a06b8d12a53d8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:57.271679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 13:27:57.272526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:57.276485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 234/478] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 12 13:27:57 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:27:57.283497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c53ad-01a6-41e8-8e43-c5aaee19936a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:57.383947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:57.393701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c53ad-01a6-41e8-8e43-c5aaee19936a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:57.431663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdac1fe-a041-45bb-b482-f456ae9893ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:57.432508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdac1fe-a041-45bb-b482-f456ae9893ed None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:57.432788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdac1fe-a041-45bb-b482-f456ae9893ed None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:57.433118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdac1fe-a041-45bb-b482-f456ae9893ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:57.446123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdac1fe-a041-45bb-b482-f456ae9893ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0bdac1fe-a041-45bb-b482-f456ae9893ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:57.454888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:57.456377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:57.457185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 245/479] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:27:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:57.462199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:57.600513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a95e9-55a2-47d5-944e-9920f75f9548 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:57.604524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:57.638949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04474c1-29d2-4508-af94-786f301d41dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:57.639551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04474c1-29d2-4508-af94-786f301d41dc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:57.639926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04474c1-29d2-4508-af94-786f301d41dc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:57.640204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04474c1-29d2-4508-af94-786f301d41dc None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:57.641097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04474c1-29d2-4508-af94-786f301d41dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:57.641406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04474c1-29d2-4508-af94-786f301d41dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:57.642797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04474c1-29d2-4508-af94-786f301d41dc None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:57.651666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 235/480] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:27:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:58.835385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec14910-fd3a-462e-9e5b-68a180648dd8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:58.836379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec14910-fd3a-462e-9e5b-68a180648dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:58.836870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec14910-fd3a-462e-9e5b-68a180648dd8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:58.838695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 246/481] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:58.844514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1221-46fb-4ca0-9960-6d821ef18044 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:58.845390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1221-46fb-4ca0-9960-6d821ef18044 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:58.845859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b1221-46fb-4ca0-9960-6d821ef18044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:58.863240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1b7b1221-46fb-4ca0-9960-6d821ef18044 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:58.864740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1b7b1221-46fb-4ca0-9960-6d821ef18044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:58.939773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 236/482] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:27:58.956116 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec14910-fd3a-462e-9e5b-68a180648dd8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:59.076374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec14910-fd3a-462e-9e5b-68a180648dd8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:59.121411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17a5f21-26e5-42ea-aeb2-4f04cc80afbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:59.122249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5f21-26e5-42ea-aeb2-4f04cc80afbc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.122535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5f21-26e5-42ea-aeb2-4f04cc80afbc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.122811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17a5f21-26e5-42ea-aeb2-4f04cc80afbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.140461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17a5f21-26e5-42ea-aeb2-4f04cc80afbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-e17a5f21-26e5-42ea-aeb2-4f04cc80afbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:59.148313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:59.149188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:59.150358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 247/483] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:27:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:59.158325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b1221-46fb-4ca0-9960-6d821ef18044 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:59.277964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:59.287875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b1221-46fb-4ca0-9960-6d821ef18044 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:59.333427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:59.334174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.334464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.334765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.335548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:59.335895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:59.337278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:59.350462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 237/484] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:27:59.351480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2e27-d86c-439c-bff7-676b0531769e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.351808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2e27-d86c-439c-bff7-676b0531769e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.352092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2e27-d86c-439c-bff7-676b0531769e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.353709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 248/485] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:27:59.356089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:59.358601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5219-ec58-470b-8c8c-61fd81c6fa14 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.359005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5219-ec58-470b-8c8c-61fd81c6fa14 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.359287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e5219-ec58-470b-8c8c-61fd81c6fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.377024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7f0e5219-ec58-470b-8c8c-61fd81c6fa14 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:59.378229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7f0e5219-ec58-470b-8c8c-61fd81c6fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:59.390553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:59.455428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f86293-0e59-4b1c-8321-45446b97915b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:59.489230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:59.490054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.490341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.490612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.500240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 249/486] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:59.501837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2cd95-2880-4271-a750-8673698aaf6d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.502039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:59.502411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2cd95-2880-4271-a750-8673698aaf6d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.502817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2cd95-2880-4271-a750-8673698aaf6d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.503531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:59.504436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 250/487] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:27:59.509751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9857e-f094-4fda-bb30-750c58b3c9a6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.510190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9857e-f094-4fda-bb30-750c58b3c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.510615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9857e-f094-4fda-bb30-750c58b3c9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:27:59.521420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:59.522491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:59.523523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:27:59.523523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:27:59.523523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:27:59.523523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:59.527226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 238/488] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:59.528801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:59.530626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6ee9857e-f094-4fda-bb30-750c58b3c9a6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:27:59.532076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6ee9857e-f094-4fda-bb30-750c58b3c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:27:59.543641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:59.613841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 251/489] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:27:59.614840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9857e-f094-4fda-bb30-750c58b3c9a6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:59.664346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335eb12-7296-4096-952f-7669ed0327f1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:59.693376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:59.715658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:59.717274 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.717858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.718407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.719633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:27:59.720537 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:59.722641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:59.725890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9857e-f094-4fda-bb30-750c58b3c9a6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:59.739935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 239/490] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:27:59.741044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:59.772047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f65aae-df83-434f-b68b-eb77900adcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:59.773758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65aae-df83-434f-b68b-eb77900adcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.774352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65aae-df83-434f-b68b-eb77900adcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.774899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65aae-df83-434f-b68b-eb77900adcd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.789165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f65aae-df83-434f-b68b-eb77900adcd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-63f65aae-df83-434f-b68b-eb77900adcd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:59.800161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:59.801065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:27:59.801957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:27:59.809961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 252/491] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:27:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:59.809961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f65aae-df83-434f-b68b-eb77900adcd6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:59.828579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:59.870872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ced19-a0bb-494d-a822-4f4ad5e7fae0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:59.911196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b123f4-d41c-4fa0-98d7-ccaf215fe4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:59.912196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b123f4-d41c-4fa0-98d7-ccaf215fe4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.912568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b123f4-d41c-4fa0-98d7-ccaf215fe4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.912932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b123f4-d41c-4fa0-98d7-ccaf215fe4c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.923794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f65aae-df83-434f-b68b-eb77900adcd6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:27:59.928092 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b123f4-d41c-4fa0-98d7-ccaf215fe4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-30b123f4-d41c-4fa0-98d7-ccaf215fe4c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:27:59.938719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:59.939860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:27:59.940851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:27:59.943775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 240/492] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:27:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:27:59.945147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b123f4-d41c-4fa0-98d7-ccaf215fe4c8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:27:59.957857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:27:59.964039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:27:59.964870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:27:59.965228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:27:59.965627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:27:59.974607 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:27:59.976168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:27:59.993178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:27:59.994348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:27:59.995477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:00.001556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 253/493] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:27:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:00.002503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.084409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b123f4-d41c-4fa0-98d7-ccaf215fe4c8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.113733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:00.114716 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e980b1c-13b8-4ca7-9f18-227f12be60de None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.120016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.121174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.121686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.122375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.123500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:00.124036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:00.125445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:00.134085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 241/494] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:00.134949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.154713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c15f9-2702-422e-ab2f-886da6f92900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.155341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c15f9-2702-422e-ab2f-886da6f92900 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.155658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c15f9-2702-422e-ab2f-886da6f92900 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.155944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c15f9-2702-422e-ab2f-886da6f92900 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.156705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c15f9-2702-422e-ab2f-886da6f92900 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:00.157016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c15f9-2702-422e-ab2f-886da6f92900 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:00.158404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c15f9-2702-422e-ab2f-886da6f92900 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:00.168370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 254/495] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:00.170216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931ef6-1a1b-4ba5-b3f1-ef2f9a3a5c4f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.170501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931ef6-1a1b-4ba5-b3f1-ef2f9a3a5c4f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.170773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80931ef6-1a1b-4ba5-b3f1-ef2f9a3a5c4f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.172163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 255/496] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:00.173001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80931ef6-1a1b-4ba5-b3f1-ef2f9a3a5c4f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.228625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:00.252719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373c79b-53c3-4922-96a7-1825ff41c930 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.277270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80931ef6-1a1b-4ba5-b3f1-ef2f9a3a5c4f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.288491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.289093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.289377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.289681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.290528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:00.290849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:00.292331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:00.309569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5adfe4-f806-417e-9c9b-7389eea9b7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.310379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5adfe4-f806-417e-9c9b-7389eea9b7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.310656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5adfe4-f806-417e-9c9b-7389eea9b7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.310928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5adfe4-f806-417e-9c9b-7389eea9b7b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.321430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5adfe4-f806-417e-9c9b-7389eea9b7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:00.322851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5adfe4-f806-417e-9c9b-7389eea9b7b2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:00.328578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 242/497] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:00.329406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7a5adfe4-f806-417e-9c9b-7389eea9b7b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:00.340921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:00.341840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:00.342673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:00.342673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:00.342673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:00.342673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:00.342921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 256/498] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:00.344211 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab29d-8149-4991-bc7f-069b76b2ee72 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.344470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab29d-8149-4991-bc7f-069b76b2ee72 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.344747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcab29d-8149-4991-bc7f-069b76b2ee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.361563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cbcab29d-8149-4991-bc7f-069b76b2ee72 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:00.362747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cbcab29d-8149-4991-bc7f-069b76b2ee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:00.386267 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:00.427846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 257/499] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:00.428998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d27c-85a7-424e-bbf0-c05e8e11b09e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.429284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d27c-85a7-424e-bbf0-c05e8e11b09e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.429563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4d27c-85a7-424e-bbf0-c05e8e11b09e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.430804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 258/500] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:00.431495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d27c-85a7-424e-bbf0-c05e8e11b09e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.441143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5387ca-6537-4f79-825d-811454fdb07a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.471818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:00.474612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.475547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.475857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.476137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.486171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:00.487665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:00.504849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:00.505765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:00.506600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:00.506600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:00.506600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:00.506600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:00.506600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 243/501] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:00.506871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.534975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4d27c-85a7-424e-bbf0-c05e8e11b09e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.567064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015a03d-6aae-45cc-90c5-fd1c26226271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.567792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015a03d-6aae-45cc-90c5-fd1c26226271 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.568069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015a03d-6aae-45cc-90c5-fd1c26226271 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.568340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015a03d-6aae-45cc-90c5-fd1c26226271 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.608868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8bf41-88f7-42c6-9eba-a7204984b0b9 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.610349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:00.635744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015a03d-6aae-45cc-90c5-fd1c26226271 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:00.637292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015a03d-6aae-45cc-90c5-fd1c26226271 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:00.642449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998583d-0ed9-4f83-8b33-f01463b715e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.643108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998583d-0ed9-4f83-8b33-f01463b715e4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.643384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998583d-0ed9-4f83-8b33-f01463b715e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.643691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998583d-0ed9-4f83-8b33-f01463b715e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.644403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998583d-0ed9-4f83-8b33-f01463b715e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:00.644706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998583d-0ed9-4f83-8b33-f01463b715e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:00.646076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998583d-0ed9-4f83-8b33-f01463b715e4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:00.661152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 244/502] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:00.662525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733225-7ea9-409a-b50f-e10b8af3192a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.662806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733225-7ea9-409a-b50f-e10b8af3192a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.663078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77733225-7ea9-409a-b50f-e10b8af3192a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.680160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-77733225-7ea9-409a-b50f-e10b8af3192a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:00.681008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:00.681392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-77733225-7ea9-409a-b50f-e10b8af3192a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:00.745993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 259/503] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:00.746843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015a03d-6aae-45cc-90c5-fd1c26226271 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.751068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 245/504] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:00.752161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733225-7ea9-409a-b50f-e10b8af3192a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.845367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015a03d-6aae-45cc-90c5-fd1c26226271 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.847325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:00.856401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77733225-7ea9-409a-b50f-e10b8af3192a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:00.879577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2492ec-90b9-45c8-bf80-56f73e4721d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.880453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2492ec-90b9-45c8-bf80-56f73e4721d8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.880804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2492ec-90b9-45c8-bf80-56f73e4721d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.881141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2492ec-90b9-45c8-bf80-56f73e4721d8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.883817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:00.889944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:00.890613 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:00.890898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:00.891170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:00.891928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:00.892239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:00.892324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2492ec-90b9-45c8-bf80-56f73e4721d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:00.893618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4f2492ec-90b9-45c8-bf80-56f73e4721d8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:00.900229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:00.901274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:00.902071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 260/505] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:00.902734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2492ec-90b9-45c8-bf80-56f73e4721d8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:00.906713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 246/506] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:00.907521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.001014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2492ec-90b9-45c8-bf80-56f73e4721d8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.005939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516f558a-51aa-449a-9edd-51baed12b77f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.033387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.034174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.034451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.034722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.038268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.039116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.039399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.039710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.041993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.043462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.050298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.051782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:01.057163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:01.058016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:01.058873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 261/507] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:01.059880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:01.070611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:01.071498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:01.072402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:01.072402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:01.072402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:01.072402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:01.072402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 247/508] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:01.072661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.076339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.122429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.166839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bcad53-b919-44f0-9ef2-317941b99dd5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.172942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93daf29-93bc-43b6-a375-e9c32d41665f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.199423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.200270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.200555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.200831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.206144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.206823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.207109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.207390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.208175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:01.208487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.209886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.211708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.213148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.217802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 248/509] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:01.218574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:01.230268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:01.231196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:01.232373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:01.232373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:01.232373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:01.232373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:01.232373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 262/510] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:01.232373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.289779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.325396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7218a6-00cd-4083-abae-ae697f1a18b6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.328364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298828b5-fee5-4d91-9224-e9e76afe27e9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.336802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.359310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.360139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.360405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.360681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.361594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.362265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.362549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.362826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.363702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:01.364012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.365444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.368868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.370302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:01.385494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:01.386541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:01.387518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 249/511] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:01.388116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.407943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 263/512] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:01.408919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.488952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7669e6-4cc0-461a-af68-fe2115bf49b9 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.505140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798bc21-821e-44b4-a907-a45d31e9044d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.513885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.523137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.523843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.524131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.524411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.525137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:01.525450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.526831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.537403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.538191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.538277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 250/513] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:01.538471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.538747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.539071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.549112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.550552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:01.568695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:01.569698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:01.575426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:01.575426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:01.575426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:01.575426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:01.575426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 264/514] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:01.575426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.593531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.642336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de81f-15b5-4253-ae3d-58906b00f542 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.674098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225c06b-7437-4e6e-9fbb-88093c100738 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.678894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.679997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.680451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.680827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.682008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:01.682524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.685217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.696655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 251/515] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:01.697435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.713266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.713949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.714232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.714508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.715682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:01.716022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.717466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.734296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 265/516] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:01.739046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.745818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.797839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e8567-bd52-4395-8bcf-2ecc1a05fd48 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.810002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.831036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd30be6-9023-4598-8956-e5e27e2f5f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.831721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd30be6-9023-4598-8956-e5e27e2f5f9b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.832008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd30be6-9023-4598-8956-e5e27e2f5f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.832286 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd30be6-9023-4598-8956-e5e27e2f5f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.833093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2a3f8-9f11-46ba-9139-1c5a8a67fc70 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:01.865815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:01.866677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:01.866959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:01.867227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:01.873686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.875168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:01.889070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:01.890009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:01.890890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 266/517] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:01.891364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:01.902349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd30be6-9023-4598-8956-e5e27e2f5f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:01.903966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd30be6-9023-4598-8956-e5e27e2f5f9b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:01.948157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:01.991814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb72465-6c07-4c0c-a89c-5e3f42988d2c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.000518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 252/518] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:02.001329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd30be6-9023-4598-8956-e5e27e2f5f9b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.025572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.026235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.026520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.026781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.027526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:02.027909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.029280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.032065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.041783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 267/519] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:02.042641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.103161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd30be6-9023-4598-8956-e5e27e2f5f9b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.137125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635f2f5-7f29-4a95-843e-51d08339f74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.137854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635f2f5-7f29-4a95-843e-51d08339f74f None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.138137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635f2f5-7f29-4a95-843e-51d08339f74f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.138263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa613ef-c49a-482e-bd68-50ce6a527300 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.138415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635f2f5-7f29-4a95-843e-51d08339f74f None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.139111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635f2f5-7f29-4a95-843e-51d08339f74f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.140754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635f2f5-7f29-4a95-843e-51d08339f74f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.170687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007caeb0-99f6-4adb-9a73-d6e5fb8d3407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.171360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007caeb0-99f6-4adb-9a73-d6e5fb8d3407 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.171666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007caeb0-99f6-4adb-9a73-d6e5fb8d3407 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.171943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007caeb0-99f6-4adb-9a73-d6e5fb8d3407 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.172071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 253/520] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:28:02 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:02.173278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635f2f5-7f29-4a95-843e-51d08339f74f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.177611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.251992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.259786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007caeb0-99f6-4adb-9a73-d6e5fb8d3407 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.261284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007caeb0-99f6-4adb-9a73-d6e5fb8d3407 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.295448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635f2f5-7f29-4a95-843e-51d08339f74f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.337925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.338609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.339553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.339553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.340002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:02.340345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.341934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.361975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 254/521] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:02.362911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.375174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 268/522] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:02.376067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007caeb0-99f6-4adb-9a73-d6e5fb8d3407 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.432810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.470060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.477072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007caeb0-99f6-4adb-9a73-d6e5fb8d3407 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.477561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d56d3-5928-4ace-a710-b54dc1cfae50 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.513217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.514360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.514828 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.515284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.515827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.516640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.516923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.517222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.523884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.525589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.528394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.529850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:02.541119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:02.542024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:28:02.542911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:02.547656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:02.548505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:02.549499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:02.549499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:02.549499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:02.549499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:02.549499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 255/523] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:02.550238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.551895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 269/524] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:02.554181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.658929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071abe4b-8719-42de-9837-2cac3c30dc58 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.660736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf46809-d7ef-4655-9aa9-a9d6de456416 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.675808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.698210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.699041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.699280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.699545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.700707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.701379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.701689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.701930 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.702771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=6eb064e8062d4a4eb7a7974f7200c86f) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:02.703085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.704577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.710592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.724057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 256/525] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/role_assignments?user.id=6eb064e8062d4a4eb7a7974f7200c86f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:02.724256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.724362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:02.744028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:02.744968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:02.745895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:02.745895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:02.745895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:02.745895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:02.745895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 270/526] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:02.746255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.758231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.858647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3bf04-e15f-44db-ae62-542d83f0d87e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.869530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a7633-7223-45cb-a66c-a09f3543e4ed None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:02.895580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.896450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.896734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.897006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.897755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:02.898056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.899419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.911976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 271/527] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:02.912785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.917474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:02.918769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:02.919057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:02.919334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:02.920217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:02.920528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:02.921966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:02.945750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 257/528] 10.222.0.64 () {56 vars in 1139 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:02.946657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:02.988770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:02.999252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:03.039810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e17ef-f74a-4ce0-b2c5-35abc8969194 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.072736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde33d7c-a70a-41db-a91f-2613bec9c8d5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.079371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.080312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.080846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.081429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.082452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:03.082970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.084650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.098322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 272/529] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:03.099646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:03.109044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.109044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.109294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.109530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.116823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.118301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:03.133509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:03.134419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:03.135302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:03.135302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:03.135302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:03.135302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:03.135302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:03.135302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:03.135302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:03.135302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:03.139673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 258/530] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:03.140608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:03.213173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f0efd-c4c3-485f-873f-8eb185aa2f88 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.240048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:03.241033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:03.247329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7f78c-7ddc-41a6-8d39-13b9ffffb694 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.250656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e919-922c-4a59-82e4-5a3c0d1bb85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.251155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e919-922c-4a59-82e4-5a3c0d1bb85b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.251536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e919-922c-4a59-82e4-5a3c0d1bb85b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.251958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37e919-922c-4a59-82e4-5a3c0d1bb85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.284851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.285984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.286402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.286847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.294207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.295999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:03.311903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:03.312835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:03.313652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:03.313652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:03.313652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:03.313652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:03.313652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:03.313652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:03.313652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:03.313652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:03.316321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 259/531] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:03.317432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:03.327890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37e919-922c-4a59-82e4-5a3c0d1bb85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.329462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37e919-922c-4a59-82e4-5a3c0d1bb85b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.421678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495e34-ebc8-4abc-8e07-5868d50a2c81 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.430774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 273/532] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:03.431862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e919-922c-4a59-82e4-5a3c0d1bb85b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:03.457877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.458874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.459323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.459951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.460773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:03.462107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:03.462838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.464921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.483101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 260/533] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:03.484338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:03.503105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:03.535193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37e919-922c-4a59-82e4-5a3c0d1bb85b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.570553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.571333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.571760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.572088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.573197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:03.573302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.574807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.592247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e300c7-59de-4854-b5e8-b2211521613f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.592865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 274/534] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:03.593706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:03.629649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.630720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.631169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.631628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.642832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.644709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:03.672486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:03.673343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:03.674204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:03.674204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:03.674204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:03.674204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:03.676546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 261/535] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:03.677638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:03.683292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:03.697190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edef6f-39ac-4410-a261-2eb01b5866a5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.731795 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.732525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.732812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.733090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.733934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=b1dd830b8f7846e78d8f007ac436d95b) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:03.734249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.735800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.747628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 275/536] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/role_assignments?user.id=b1dd830b8f7846e78d8f007ac436d95b&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:03.747628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:03.768431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:03.834303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a27b747-9468-4b1b-8d2d-7af3b7673a0b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.887270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f549a4e-4505-41c6-9c69-07ead1f06f9b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:03.909397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.910465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.910941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.911404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.912626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=1df6ff57287645b2ae6f3b68543d6fbf) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:03.913129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.914748 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.927782 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:03.928804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:03.929184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:03.929561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:03.930405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:03.930811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:03.931752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 262/537] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/role_assignments?user.id=1df6ff57287645b2ae6f3b68543d6fbf&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:03.932559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:03.948307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 276/538] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:03.953503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:04.084354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6e126-7c24-4050-8576-8bd62ff78f84 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:04.116638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:04.121982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6b853-cfb9-4933-992b-b57bda6c35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:04.122847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b853-cfb9-4933-992b-b57bda6c35de None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:04.123127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b853-cfb9-4933-992b-b57bda6c35de None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:04.123398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6b853-cfb9-4933-992b-b57bda6c35de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:04.130869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6b853-cfb9-4933-992b-b57bda6c35de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:04.132396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6b853-cfb9-4933-992b-b57bda6c35de None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-60d6b853-cfb9-4933-992b-b57bda6c35de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:04.146495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:04.147451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:04.149036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 263/539] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:04.153768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:04.170931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:04.236807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154850a-ba42-4dad-8160-39c9be8250ad None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:04.236997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154850a-ba42-4dad-8160-39c9be8250ad None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:04.237263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154850a-ba42-4dad-8160-39c9be8250ad None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:04.238634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 264/540] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:04.243940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8514e-acfc-4cfb-aad9-c12b24245cb8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:04.244483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8514e-acfc-4cfb-aad9-c12b24245cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:04.244957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8514e-acfc-4cfb-aad9-c12b24245cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:04.275449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b1e8514e-acfc-4cfb-aad9-c12b24245cb8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:04.277214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b1e8514e-acfc-4cfb-aad9-c12b24245cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:04.287536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d64ee20-bc5b-4ee5-8694-34733a8e0d01 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:04.351633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:04.352598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:04.353022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:04.353438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:04.355335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:04.357024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:04.358667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:04.366823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 265/541] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:28:04.379501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 277/542] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:04.385149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8514e-acfc-4cfb-aad9-c12b24245cb8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:04.398387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:04.470345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:04.530945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250babe-78a5-4ee4-aead-56820f1f5d62 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:04.576202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8514e-acfc-4cfb-aad9-c12b24245cb8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:04.594280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf3d84-2210-4e84-8804-140116388f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:04.595376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf3d84-2210-4e84-8804-140116388f41 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:04.595954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf3d84-2210-4e84-8804-140116388f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:04.596398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf3d84-2210-4e84-8804-140116388f41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:04.602523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:04.617950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:04.618625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:04.618908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:04.619184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:04.620058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=bcdda7fcb39248c1a5a36ee699d23c73) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:04.620374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:04.621868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:04.624485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf3d84-2210-4e84-8804-140116388f41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-e9cf3d84-2210-4e84-8804-140116388f41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:04.632177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:04.633223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:04.634323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 278/543] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:04.643182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 266/544] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:04 2022] GET /identity/v3/role_assignments?user.id=bcdda7fcb39248c1a5a36ee699d23c73&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:04.643407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf3d84-2210-4e84-8804-140116388f41 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:04.784781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf3d84-2210-4e84-8804-140116388f41 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:04.839490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:04.848685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745ca10-7e2c-42c0-9657-c697dee6d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:04.849394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745ca10-7e2c-42c0-9657-c697dee6d755 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:04.849675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745ca10-7e2c-42c0-9657-c697dee6d755 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:04.849950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745ca10-7e2c-42c0-9657-c697dee6d755 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:04.850719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745ca10-7e2c-42c0-9657-c697dee6d755 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:04.851024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745ca10-7e2c-42c0-9657-c697dee6d755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:04.856659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b745ca10-7e2c-42c0-9657-c697dee6d755 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:04.865867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 279/545] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:04.871949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:04.982215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b55da-d179-4d78-8e9e-df6a15ea76f0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:05.024300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:05.025132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:05.025417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:05.025693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:05.033783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49639e-3abe-4251-8e05-c01dabb246c8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:05.034068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49639e-3abe-4251-8e05-c01dabb246c8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:05.034344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49639e-3abe-4251-8e05-c01dabb246c8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:05.036036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 280/546] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:05.040539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:05.042072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:05.042182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c07f4-2218-49db-9652-efa4d8cc1652 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:05.042434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c07f4-2218-49db-9652-efa4d8cc1652 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:05.042812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c07f4-2218-49db-9652-efa4d8cc1652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:05.061619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-277c07f4-2218-49db-9652-efa4d8cc1652 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:05.062829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-277c07f4-2218-49db-9652-efa4d8cc1652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:05.065909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:05.066770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:05.067636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:05.067636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:05.067636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:05.067636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:05.067636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 267/547] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:05.072561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:05.142872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:05.179699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 281/548] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 13:28:05.214961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c07f4-2218-49db-9652-efa4d8cc1652 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:05.261711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b9d04-529c-4df8-b476-d95f1360aa25 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:05.330555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:05.331242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:05.331526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:05.331834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:05.332596 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:05.332916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:05.334327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:05.351775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 268/549] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:05.362809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:05.365662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c07f4-2218-49db-9652-efa4d8cc1652 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:05.411984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:05.431199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee19879-6ea9-4afb-8bbb-31f786df3a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:05.432039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19879-6ea9-4afb-8bbb-31f786df3a90 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:05.432316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19879-6ea9-4afb-8bbb-31f786df3a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:05.432589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee19879-6ea9-4afb-8bbb-31f786df3a90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:05.454244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee19879-6ea9-4afb-8bbb-31f786df3a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-bee19879-6ea9-4afb-8bbb-31f786df3a90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:05.462422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:05.463860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:05.464833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:05.466629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 282/550] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:05.473809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee19879-6ea9-4afb-8bbb-31f786df3a90 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:05.549652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:05.555220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c27e32-2546-45f9-bff8-454b53f3bf13 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:05.621152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:05.621973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:05.622262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:05.622536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:05.635789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee19879-6ea9-4afb-8bbb-31f786df3a90 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:05.636820 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:05.638391 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:05.672118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:05.673083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:05.674406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 269/551] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:05.679818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:05.680476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:05.681323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:05.681765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:05.682196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:05.683102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:05.683550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:05.685693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:05.696075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 283/552] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:05.706505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:05.802254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4404eb7-ba2d-4adb-9766-e5a2232e7fa5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:05.819972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:05.841530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:05.842223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:05.842510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:05.842788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:05.843664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:05.843981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:05.845426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:05.883877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 270/553] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 12 13:28:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:05.889713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:05.921463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d334c9c-af71-45e2-a0b5-9bc1ff0c094e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:05.924229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.009217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.010036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.010314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.010586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.020466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04e754-ad75-4b2e-a5b7-2727c3595bb1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:06.032495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:06.033959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:06.055544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154631a-4c6f-4537-8f80-339e36183456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.056244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154631a-4c6f-4537-8f80-339e36183456 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.056534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154631a-4c6f-4537-8f80-339e36183456 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.056814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3154631a-4c6f-4537-8f80-339e36183456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:06.065574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:06.066457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:06.067332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:06.067332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:06.067332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:06.067332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:06.076038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 284/554] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:06.081313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:06.127548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154631a-4c6f-4537-8f80-339e36183456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:06.129507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3154631a-4c6f-4537-8f80-339e36183456 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:06.152067 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.235113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 271/555] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:06.240383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.241937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154631a-4c6f-4537-8f80-339e36183456 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:06.243582 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5711780-9cab-4839-8957-b65b66645497 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:06.278993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1baff86-37da-4b37-abd4-b00d81e05c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.279692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baff86-37da-4b37-abd4-b00d81e05c26 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.279972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baff86-37da-4b37-abd4-b00d81e05c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.280248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1baff86-37da-4b37-abd4-b00d81e05c26 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.280972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baff86-37da-4b37-abd4-b00d81e05c26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:06.281277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baff86-37da-4b37-abd4-b00d81e05c26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:06.282648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1baff86-37da-4b37-abd4-b00d81e05c26 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:06.295421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 285/556] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:06.298223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52819ee-7f98-45bc-89ce-a1928ed50aea None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.298511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52819ee-7f98-45bc-89ce-a1928ed50aea None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.299421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52819ee-7f98-45bc-89ce-a1928ed50aea None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.301182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 286/557] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:06.302047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52819ee-7f98-45bc-89ce-a1928ed50aea None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:06.378240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3154631a-4c6f-4537-8f80-339e36183456 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:06.395430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.417041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ad1d7-4e9c-4cd6-847e-93643b71e03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.417770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ad1d7-4e9c-4cd6-847e-93643b71e03d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.418051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ad1d7-4e9c-4cd6-847e-93643b71e03d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.418322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ad1d7-4e9c-4cd6-847e-93643b71e03d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.429063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52819ee-7f98-45bc-89ce-a1928ed50aea None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:06.431535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ad1d7-4e9c-4cd6-847e-93643b71e03d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:06.433028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ad1d7-4e9c-4cd6-847e-93643b71e03d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-956ad1d7-4e9c-4cd6-847e-93643b71e03d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:06.453341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:06.454668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:06.455523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:06.455523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:06.455523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:06.455523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:06.455523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 272/558] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:06.456449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e155a-7f5f-4785-b299-304226112eec None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.456736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e155a-7f5f-4785-b299-304226112eec None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.457012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e155a-7f5f-4785-b299-304226112eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.468435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c49f6-5beb-43c0-b2a9-8ea47e4fd953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.469245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c49f6-5beb-43c0-b2a9-8ea47e4fd953 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.469542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c49f6-5beb-43c0-b2a9-8ea47e4fd953 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.469819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c49f6-5beb-43c0-b2a9-8ea47e4fd953 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.474789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7c7e155a-7f5f-4785-b299-304226112eec None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:06.476169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7c7e155a-7f5f-4785-b299-304226112eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:06.477388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c49f6-5beb-43c0-b2a9-8ea47e4fd953 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:06.478827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2c49f6-5beb-43c0-b2a9-8ea47e4fd953 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-cc2c49f6-5beb-43c0-b2a9-8ea47e4fd953 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:06.493539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:06.494474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:06.495521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 287/559] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:06.496512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efcecf-25e9-416a-87da-12a77218d19e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.496512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efcecf-25e9-416a-87da-12a77218d19e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.496651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efcecf-25e9-416a-87da-12a77218d19e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.497944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 288/560] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:06.502578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efcecf-25e9-416a-87da-12a77218d19e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:06.522382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.553581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 273/561] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:06.554670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e155a-7f5f-4785-b299-304226112eec None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:06.614301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efcecf-25e9-416a-87da-12a77218d19e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:06.648245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05e61d-10f6-4042-8378-a99a16e403a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.648912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e61d-10f6-4042-8378-a99a16e403a1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.649190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e61d-10f6-4042-8378-a99a16e403a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.649459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05e61d-10f6-4042-8378-a99a16e403a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.650207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e61d-10f6-4042-8378-a99a16e403a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:06.650513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e61d-10f6-4042-8378-a99a16e403a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:06.651900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05e61d-10f6-4042-8378-a99a16e403a1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:06.662239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.663462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 289/562] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:06.666537 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e155a-7f5f-4785-b299-304226112eec None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:06.669340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc05aa0-a419-4e93-8731-20710a7aea15 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.669566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc05aa0-a419-4e93-8731-20710a7aea15 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.669839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc05aa0-a419-4e93-8731-20710a7aea15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.686755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9dc05aa0-a419-4e93-8731-20710a7aea15 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:06.688015 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9dc05aa0-a419-4e93-8731-20710a7aea15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:06.702853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.703553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.703860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.704128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.704964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:06.705268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:06.706825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:06.729188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 274/563] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:06.729188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:06.771643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 290/564] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:06.771643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc05aa0-a419-4e93-8731-20710a7aea15 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:06.789321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.846457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62067f1d-371b-4252-9074-0d4ddee455e4 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:06.882774 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b5e0-9e85-400f-8fad-cd1675917b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.883042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc05aa0-a419-4e93-8731-20710a7aea15 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:06.883579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b5e0-9e85-400f-8fad-cd1675917b1a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.883900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b5e0-9e85-400f-8fad-cd1675917b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.884170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839b5e0-9e85-400f-8fad-cd1675917b1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.895079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839b5e0-9e85-400f-8fad-cd1675917b1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-b839b5e0-9e85-400f-8fad-cd1675917b1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:06.902910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:06.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:06.904708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 275/565] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:06.905401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b5e0-9e85-400f-8fad-cd1675917b1a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:06.924619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:06.930540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:06.931342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:06.931685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:06.932039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:06.940011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:06.941586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:06.956342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:06.957215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:06.958086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 291/566] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:06.958564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.020095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839b5e0-9e85-400f-8fad-cd1675917b1a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.026891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.057510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.058307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.058584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.058849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.064199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a37a79-fe7b-441e-a9de-43c3d9fb456f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.070954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.072588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:07.092103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:07.093048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:07.093968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:07.093968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:07.093968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:07.093968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:07.093968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 276/567] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:07.094953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.102276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e4b9-ec9a-4578-b1a8-d9832331be24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.103096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e4b9-ec9a-4578-b1a8-d9832331be24 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.103370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e4b9-ec9a-4578-b1a8-d9832331be24 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.103667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9e4b9-ec9a-4578-b1a8-d9832331be24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.114335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9e4b9-ec9a-4578-b1a8-d9832331be24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-b7f9e4b9-ec9a-4578-b1a8-d9832331be24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:07.122527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:07.123448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:07.124330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 292/568] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:07.125011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e4b9-ec9a-4578-b1a8-d9832331be24 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.176286 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.213700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04eafd-93fb-4722-9cf2-1e7bc746e3bb None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.226512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9e4b9-ec9a-4578-b1a8-d9832331be24 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.247988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.248754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.249021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.249313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.250136 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:07.250447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.251833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.252292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.259904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 277/569] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:07.260759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.261057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.261431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.261712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.261987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.262817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:07.263123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.264824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.277276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 293/570] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:07.278101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.361871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d884ed-e8a5-40f6-9e98-12f43f1c7f79 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.376778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28062bb-cd4f-4e69-9220-e4c7e2fb3a04 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.389414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.395549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6c06b3-9160-488c-a973-d54d4af3e893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.396244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c06b3-9160-488c-a973-d54d4af3e893 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.396528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c06b3-9160-488c-a973-d54d4af3e893 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.396807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6c06b3-9160-488c-a973-d54d4af3e893 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.397525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c06b3-9160-488c-a973-d54d4af3e893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:07.397832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c06b3-9160-488c-a973-d54d4af3e893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.399192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6c06b3-9160-488c-a973-d54d4af3e893 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.410569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.410978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 278/571] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:07.411242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.411520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.411829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.412233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be11b-49cd-495b-ba4d-7cd1b05ae8e4 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.412520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be11b-49cd-495b-ba4d-7cd1b05ae8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.412612 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:07.412796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be11b-49cd-495b-ba4d-7cd1b05ae8e4 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.412888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.415637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 279/572] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:07.415774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.415855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be11b-49cd-495b-ba4d-7cd1b05ae8e4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.426908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 294/573] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:07.426908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.472091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.514815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be11b-49cd-495b-ba4d-7cd1b05ae8e4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.521735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51bd21e-6a87-447e-aa20-2cedba4f2bbd None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.547980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94d07-d5d5-4fd0-9843-30260abcb919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.548781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94d07-d5d5-4fd0-9843-30260abcb919 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.549068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94d07-d5d5-4fd0-9843-30260abcb919 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.549341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94d07-d5d5-4fd0-9843-30260abcb919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.553647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.554298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.554604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.554877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.555751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=a57f6f39bba04a9d80a885340239cea3) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:07.556063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.557491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.559582 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f94d07-d5d5-4fd0-9843-30260abcb919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.561035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f94d07-d5d5-4fd0-9843-30260abcb919 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.563275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 295/574] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/role_assignments?user.id=a57f6f39bba04a9d80a885340239cea3&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:07.564074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-e3f94d07-d5d5-4fd0-9843-30260abcb919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:07.579086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:07.580101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:07.580959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:07.580959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:07.580959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:07.580959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:07.581767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 280/575] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:07.584262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba7cd-82e2-4292-be39-06485899d24f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.584817 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba7cd-82e2-4292-be39-06485899d24f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.585756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cba7cd-82e2-4292-be39-06485899d24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.604436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-76cba7cd-82e2-4292-be39-06485899d24f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:07.605655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-76cba7cd-82e2-4292-be39-06485899d24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:07.653781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.690238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 281/576] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:07.690866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba7cd-82e2-4292-be39-06485899d24f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.703446 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf42b3a-7630-46f5-bdff-a5f3de984ead None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.718762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.739805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.741054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.741634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.741923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.749668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.751112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:07.766160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:07.767092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:07.768073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 296/577] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:07.769136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.800885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cba7cd-82e2-4292-be39-06485899d24f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.837260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.838055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.838334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.838600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.849401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.851011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:07.869909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:07.870861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:07.872200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:07.872200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:07.872200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:07.872200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:07.872200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 282/578] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:07.872200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.879354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14697a-16ad-4a65-90ad-f5d890507ca2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:07.897215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.918670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:07.919498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:07.919811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:07.920090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:07.920836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:07.921147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:07.922548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:07.939751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 297/579] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:07.939751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:07.971960 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:07.985382 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fccdb-0c2d-4365-90dc-d4ac77445ac6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.021961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11329cb3-96b6-4926-a5cd-1fc3f7bd22aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.022772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329cb3-96b6-4926-a5cd-1fc3f7bd22aa None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.023065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329cb3-96b6-4926-a5cd-1fc3f7bd22aa None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.023327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11329cb3-96b6-4926-a5cd-1fc3f7bd22aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.033579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11329cb3-96b6-4926-a5cd-1fc3f7bd22aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:08.040467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffa886-1332-4e3a-b3d0-d53c929330a1 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-11329cb3-96b6-4926-a5cd-1fc3f7bd22aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:08.041294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:08.042368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:08.043450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:08.047832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 283/580] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:08.048668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11329cb3-96b6-4926-a5cd-1fc3f7bd22aa None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.082369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.083036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.083319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.083591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.084404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:08.084757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.086339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.102616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 298/581] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:08.102616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.142166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:08.159725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11329cb3-96b6-4926-a5cd-1fc3f7bd22aa None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.197672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:08.199462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.200379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.200661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.200946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.201730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:08.202028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.203414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.206072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78debda1-4652-4609-aeb0-226507ca0dcb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.215352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 284/582] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:08.216164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.248344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.249149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.249324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.249595 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.258260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.259723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:08.288007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:08.289221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:08.290263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 299/583] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:08.291329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.350144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059803b0-dcb7-43e2-8075-bab84f66997c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.388443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.389170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.389451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.389723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.390611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:08.391022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.392427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.399942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6af2f0-bb09-4e78-836b-1780bd488208 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.405372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 285/584] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:08.405372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.412676 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:08.440285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c516ae-61da-4916-abd4-ce8ffde09a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.441293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c516ae-61da-4916-abd4-ce8ffde09a4c None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.441574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c516ae-61da-4916-abd4-ce8ffde09a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.441973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c516ae-61da-4916-abd4-ce8ffde09a4c None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/6eb064e8062d4a4eb7a7974f7200c86f/roles/eb1899ecc6e0420f90de62e74998ca33` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.456854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c516ae-61da-4916-abd4-ce8ffde09a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=6eb064e8062d4a4eb7a7974f7200c86f, role_id=eb1899ecc6e0420f90de62e74998ca33)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.458576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c516ae-61da-4916-abd4-ce8ffde09a4c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.472537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 300/585] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:08 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/6eb064e8062d4a4eb7a7974f7200c86f/roles/eb1899ecc6e0420f90de62e74998ca33 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:08.473143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c516ae-61da-4916-abd4-ce8ffde09a4c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.477508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:08.551936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c48ee7-26ec-4205-9106-7bef7021696a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.590022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c516ae-61da-4916-abd4-ce8ffde09a4c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.604316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.606374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.607161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.607667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.619182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.622026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.630008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.630710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.630996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.631276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.633036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:08.633359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.634909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:08.645233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:08.646221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:28:08.647825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:08.650475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 286/586] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:08.654831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.665193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 301/587] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:08.667289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.734415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:08.735239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:08.780416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a986d-6096-4c75-b84a-9fa61ce22fa9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.787062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b19c2-0785-48c3-b16c-0de7e1e972ea None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.818521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.819247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.819529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.819847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.820748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:08.821228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.822673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.834611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.835554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.835964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.836334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:08.841203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 302/588] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:08.842052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.855981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:08.857921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:08.881623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:08.882716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:08.883658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:08.883658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:08.883658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:08.883658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:08.887491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 287/589] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:08.888551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:08.951035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897aa96c-035b-4ccd-b83e-7667fbd997ff None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:08.974647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:08.991332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:08.992333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:08.992711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:08.993081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.004269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.005909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:09.024533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:09.025621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:09.026594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:09.026594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:09.026594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:09.026594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:09.026594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 303/590] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:09.031723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.033992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7914c-de13-4240-8e3a-e2b7d37550f0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.055764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:09.079222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.080516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.080516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.080714 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.092588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.094318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:09.113184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:09.114142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:09.115044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:09.115044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:09.115044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:09.115044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:09.119535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 288/591] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:09.120064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.167861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75a2e1-ca4f-401b-8c73-66191c52ca40 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.215418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.217032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.217558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.218297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.219494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:09.220443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.222596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.229477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb822da-56f8-482c-8f89-402d0535eac3 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.244757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 304/592] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:09.244757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.270137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.270622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.270913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.271186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.271978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:09.272279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.273688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.287184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:09.287726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 289/593] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:09.288902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.322817 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:09.380530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267f767-0913-4368-a48b-2681bc60e254 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.431126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728242a-d337-4b7c-b706-ebe726782729 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.452969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.453659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.453978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.454259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.454998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:09.455305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.456706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.475653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 305/594] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:09.481449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.516356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.517232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.517512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.517785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.531222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.532796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:09.565494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:09.566512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:28:09.567473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:09.574021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 290/595] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:09.576064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.619068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:09.634804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67453542-4307-4e6d-83e2-7a6dcb701614 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.686443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.687360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.687743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.688079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.695205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.696748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.699277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:09.712326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:09.713306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:09.714229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:09.714229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:09.714229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:09.714229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:09.714229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:09.714229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:09.714229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:09.714229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:09.718419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 306/596] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:09.719264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.721072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a90ad-4a4e-497a-a170-886eac2a5778 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.764065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d6bfb-eb30-47ce-b8f9-c76c86116a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.765071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6bfb-eb30-47ce-b8f9-c76c86116a8b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.765418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6bfb-eb30-47ce-b8f9-c76c86116a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.765756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d6bfb-eb30-47ce-b8f9-c76c86116a8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.772743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d6bfb-eb30-47ce-b8f9-c76c86116a8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.774288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d6bfb-eb30-47ce-b8f9-c76c86116a8b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-617d6bfb-eb30-47ce-b8f9-c76c86116a8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:09.789175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:09.790101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:09.790995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:09.790995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:09.790995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:09.790995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:09.790995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:09.790995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:09.790995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:09.790995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:09.795671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 291/597] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:09.797100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e9a08-414a-4ff0-bf28-5e045f6d91ea None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.797380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e9a08-414a-4ff0-bf28-5e045f6d91ea None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.797656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e9a08-414a-4ff0-bf28-5e045f6d91ea None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.799090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 292/598] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:09.800373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e9a08-414a-4ff0-bf28-5e045f6d91ea None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.873818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4a63f1-31ab-4d1a-a53c-4f2bdc4b71ed None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.907650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.908597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.909066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.909346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.910216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:09.910531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.911628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e9a08-414a-4ff0-bf28-5e045f6d91ea None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:09.912001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.934088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 307/599] 10.222.0.64 () {56 vars in 1139 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:09.934088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:09.946717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:09.959622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd6949-f3eb-418a-b8aa-b7f4958515a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:09.960440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd6949-f3eb-418a-b8aa-b7f4958515a7 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.960730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd6949-f3eb-418a-b8aa-b7f4958515a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.961003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd6949-f3eb-418a-b8aa-b7f4958515a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.961928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd6949-f3eb-418a-b8aa-b7f4958515a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:09.962243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd6949-f3eb-418a-b8aa-b7f4958515a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:09.963833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd6949-f3eb-418a-b8aa-b7f4958515a7 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:09.981872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 293/600] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:09.981872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466487-dc9c-4bda-917d-64f823bb1e11 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:09.981872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466487-dc9c-4bda-917d-64f823bb1e11 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:09.981872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466487-dc9c-4bda-917d-64f823bb1e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:09.998984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b1466487-dc9c-4bda-917d-64f823bb1e11 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:10.000241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b1466487-dc9c-4bda-917d-64f823bb1e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:10.003310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:10.044936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ababa0f-0b1b-449f-b5a0-7d1efa721a32 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:10.078775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 294/601] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:10.080048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466487-dc9c-4bda-917d-64f823bb1e11 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:10.080390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:10.081087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.081369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.081641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.082463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:10.082768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:10.084248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:10.099757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 308/602] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:10.100933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:10.174812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:10.195458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466487-dc9c-4bda-917d-64f823bb1e11 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:10.207888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478b3a1-9bc6-4e2a-8176-7045f5d8d56b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:10.230231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:10.231100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.231383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.231686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.240620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:10.243065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22ed91-259d-4b48-aa1b-e1e351498e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:10.244082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:10.244192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22ed91-259d-4b48-aa1b-e1e351498e98 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.244379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22ed91-259d-4b48-aa1b-e1e351498e98 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.244650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa22ed91-259d-4b48-aa1b-e1e351498e98 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/b1dd830b8f7846e78d8f007ac436d95b/roles/eb1899ecc6e0420f90de62e74998ca33` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.247338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:10.261119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22ed91-259d-4b48-aa1b-e1e351498e98 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=b1dd830b8f7846e78d8f007ac436d95b, role_id=eb1899ecc6e0420f90de62e74998ca33)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:10.262797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa22ed91-259d-4b48-aa1b-e1e351498e98 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:10.269439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:10.270328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:10.272348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:10.272348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:10.272348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:10.272348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:10.275328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 295/603] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:10.276182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:10.277127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 309/604] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:10 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/b1dd830b8f7846e78d8f007ac436d95b/roles/eb1899ecc6e0420f90de62e74998ca33 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:10.277735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22ed91-259d-4b48-aa1b-e1e351498e98 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:10.410618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89583637-3c4a-457d-a787-4f20a3f655c4 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:10.420210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa22ed91-259d-4b48-aa1b-e1e351498e98 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:10.449907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:10.452287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150bd43-899b-4dc1-b4e8-8bcb0fccc79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:10.453185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150bd43-899b-4dc1-b4e8-8bcb0fccc79c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.453461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150bd43-899b-4dc1-b4e8-8bcb0fccc79c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.453745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150bd43-899b-4dc1-b4e8-8bcb0fccc79c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.467707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150bd43-899b-4dc1-b4e8-8bcb0fccc79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:10.469908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde63ab1-a6b1-41db-9bf1-c0cb5f1fc398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:10.470921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63ab1-a6b1-41db-9bf1-c0cb5f1fc398 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.471304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63ab1-a6b1-41db-9bf1-c0cb5f1fc398 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.472476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde63ab1-a6b1-41db-9bf1-c0cb5f1fc398 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/1df6ff57287645b2ae6f3b68543d6fbf/roles/eb1899ecc6e0420f90de62e74998ca33` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f150bd43-899b-4dc1-b4e8-8bcb0fccc79c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:10.475497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:10.476602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:10.477593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 296/605] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:10.478454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150bd43-899b-4dc1-b4e8-8bcb0fccc79c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:10.495874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63ab1-a6b1-41db-9bf1-c0cb5f1fc398 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=1df6ff57287645b2ae6f3b68543d6fbf, role_id=eb1899ecc6e0420f90de62e74998ca33)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:10.497750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde63ab1-a6b1-41db-9bf1-c0cb5f1fc398 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:10.519825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 310/606] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:10 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/1df6ff57287645b2ae6f3b68543d6fbf/roles/eb1899ecc6e0420f90de62e74998ca33 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:10.520964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde63ab1-a6b1-41db-9bf1-c0cb5f1fc398 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:10.546467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:10.620654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150bd43-899b-4dc1-b4e8-8bcb0fccc79c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:10.661126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c542c1b-390b-41f1-a2e8-1cf944cb5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:10.661819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542c1b-390b-41f1-a2e8-1cf944cb5e41 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.662099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542c1b-390b-41f1-a2e8-1cf944cb5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.662370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c542c1b-390b-41f1-a2e8-1cf944cb5e41 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.663104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c542c1b-390b-41f1-a2e8-1cf944cb5e41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:10.663415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c542c1b-390b-41f1-a2e8-1cf944cb5e41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:10.664865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c542c1b-390b-41f1-a2e8-1cf944cb5e41 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:10.677941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 297/607] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:10.679245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520df3-e9cc-4400-876e-2e9eb509f836 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.679534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520df3-e9cc-4400-876e-2e9eb509f836 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.679835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03520df3-e9cc-4400-876e-2e9eb509f836 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.683708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 298/608] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:10.687248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03520df3-e9cc-4400-876e-2e9eb509f836 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:10.717461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde63ab1-a6b1-41db-9bf1-c0cb5f1fc398 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:10.761130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad242eb-b17c-4716-9fa2-335548d3a6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:10.762518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad242eb-b17c-4716-9fa2-335548d3a6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.762518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad242eb-b17c-4716-9fa2-335548d3a6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.763078 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad242eb-b17c-4716-9fa2-335548d3a6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.765320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad242eb-b17c-4716-9fa2-335548d3a6b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:10.765320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad242eb-b17c-4716-9fa2-335548d3a6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:10.767588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad242eb-b17c-4716-9fa2-335548d3a6b4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:10.775357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 311/609] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:10.776799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e87052-9615-49f5-9cc7-3cd2b45f8830 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.777093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e87052-9615-49f5-9cc7-3cd2b45f8830 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.777371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e87052-9615-49f5-9cc7-3cd2b45f8830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.795900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-39e87052-9615-49f5-9cc7-3cd2b45f8830 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:10.797262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-39e87052-9615-49f5-9cc7-3cd2b45f8830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:10.818059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03520df3-e9cc-4400-876e-2e9eb509f836 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:10.829079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:10.831936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:10.854969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:10.856023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:10.856591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:10.856877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:10.865645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:10.867700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:10.874017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 312/610] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:10.875140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e87052-9615-49f5-9cc7-3cd2b45f8830 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:10.896102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:10.897034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:10.897913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:10.897913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:10.897913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:10.897913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:10.897913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:10.897913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:10.897913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:10.897913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:10.899904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 299/611] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:10.900754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.007675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06838f-392c-40ae-847c-9e10e4ed7d7c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.011369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e87052-9615-49f5-9cc7-3cd2b45f8830 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.050789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff69ae-2ca8-435f-8d41-59eee85057fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.051636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff69ae-2ca8-435f-8d41-59eee85057fc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.051956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff69ae-2ca8-435f-8d41-59eee85057fc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.052233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff69ae-2ca8-435f-8d41-59eee85057fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.054751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.055705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.056077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.056441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.065290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff69ae-2ca8-435f-8d41-59eee85057fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:11.067535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:11.069091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-74ff69ae-2ca8-435f-8d41-59eee85057fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:11.074583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:11.075735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:11.076751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:11.079689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 300/612] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:11.080848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff69ae-2ca8-435f-8d41-59eee85057fc None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:11.095372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:11.096327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:11.097227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:11.097227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:11.097227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:11.097227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:11.099440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 313/613] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:11.100462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.123171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:11.127105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:11.206847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ab251-55b1-429a-bfe0-b3aca1c0b231 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.216698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff69ae-2ca8-435f-8d41-59eee85057fc None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.241472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.242150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.242429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.242701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.243538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:11.243873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:11.245355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:11.254383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 314/614] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:11.255295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.261750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.262459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.262739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.263068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.263945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:11.264255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:11.265707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:11.283769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 301/615] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:11.284745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.361556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:11.381477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:11.391549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104602f8-eeb1-4c03-98f8-64300f507fb5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.393577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53c788-d6b5-4dbf-abbc-b102d3badb9b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.429918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.430541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.430726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.431009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.431779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:11.432094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:11.433477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:11.437185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.438159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.438583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.439015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.446329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 315/616] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:11.447134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.453277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:11.454917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:11.481616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:11.482761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:11.483916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:11.483916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:11.483916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:11.483916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:11.491775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 302/617] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:11.492598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.556621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2ad6ce-ac27-48e9-95ae-ae69f3fb50e2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.605235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc3848-e511-48a4-af27-9e789e0f0726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.607188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc3848-e511-48a4-af27-9e789e0f0726 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.607780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc3848-e511-48a4-af27-9e789e0f0726 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.608233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc3848-e511-48a4-af27-9e789e0f0726 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/bcdda7fcb39248c1a5a36ee699d23c73/roles/eb1899ecc6e0420f90de62e74998ca33` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.615128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:11.618790 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff239f9-f516-4c42-9acb-d9e77972019a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.633416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc3848-e511-48a4-af27-9e789e0f0726 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=bcdda7fcb39248c1a5a36ee699d23c73, role_id=eb1899ecc6e0420f90de62e74998ca33)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:11.635861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc3848-e511-48a4-af27-9e789e0f0726 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:11.658926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 316/618] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:11 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/bcdda7fcb39248c1a5a36ee699d23c73/roles/eb1899ecc6e0420f90de62e74998ca33 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:11.660141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc3848-e511-48a4-af27-9e789e0f0726 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.684950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.687893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.688432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.689281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] PATH_INFO: `/v3/users/swift` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.708554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:11.712421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:11.753671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:11.755024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:11.756373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 303/619] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:11.761171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.773587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:11.824024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc3848-e511-48a4-af27-9e789e0f0726 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.865143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:11.865842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:11.866133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:11.866413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:11.867176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:11.867489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:11.869047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:11.884472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 317/620] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:11.900388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:11.953779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2f0634-7199-4dd2-a9c2-bcfb9873efac None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:11.995990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:12.018394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:12.019561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.020116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.020580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.021709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:12.022213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:12.023886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:12.044143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 304/621] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 12 13:28:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:12.049282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:12.088063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714b210b-4d18-4f32-af4a-331ef3086ef7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:12.159767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:12.164371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:12.165218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.165493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.165758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.183921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:12.187563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:12.212177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:12.213271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:12.214215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:12.223472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71a9af-d1f8-4fbf-b888-ad4b61110b96 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:12.226615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 318/622] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:28:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:12.236520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:12.270948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:12.273304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.275504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.276799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.294576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:12.296351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:12.317574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:12.318713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:12.319798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:12.319798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:12.319798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:12.319798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:12.321708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 305/623] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:12.327466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:12.435332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66eec1-b0b2-48db-b156-e6ad4a9038fe None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:12.442515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:12.449438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f92dcf-44c3-4ec1-b798-bcadbaade025 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:12.467432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:12.481445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea5ddf-1fb3-40bf-badc-198cb3948899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:12.482135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea5ddf-1fb3-40bf-badc-198cb3948899 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.482417 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea5ddf-1fb3-40bf-badc-198cb3948899 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.482768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea5ddf-1fb3-40bf-badc-198cb3948899 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.483542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea5ddf-1fb3-40bf-badc-198cb3948899 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:12.484056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea5ddf-1fb3-40bf-badc-198cb3948899 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:12.485314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea5ddf-1fb3-40bf-badc-198cb3948899 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:12.492193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a902f2-39ff-41c0-822f-48cccaa7c27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:12.493132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a902f2-39ff-41c0-822f-48cccaa7c27d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.493573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a902f2-39ff-41c0-822f-48cccaa7c27d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.494111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a902f2-39ff-41c0-822f-48cccaa7c27d None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.494985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a902f2-39ff-41c0-822f-48cccaa7c27d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:12.495442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a902f2-39ff-41c0-822f-48cccaa7c27d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:12.497060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a902f2-39ff-41c0-822f-48cccaa7c27d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:12.503162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 319/624] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:28:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:12.507934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88d0dc-f3ef-430d-87bb-7865a26e746c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.507934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88d0dc-f3ef-430d-87bb-7865a26e746c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.507934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88d0dc-f3ef-430d-87bb-7865a26e746c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.510498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 320/625] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:12.511298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88d0dc-f3ef-430d-87bb-7865a26e746c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:12.520579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 306/626] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:12.522280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590cb37-4a73-451c-91b1-85632d60c4c0 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.522726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590cb37-4a73-451c-91b1-85632d60c4c0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.523197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3590cb37-4a73-451c-91b1-85632d60c4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.542352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3590cb37-4a73-451c-91b1-85632d60c4c0 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:12.544052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3590cb37-4a73-451c-91b1-85632d60c4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:12.613300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88d0dc-f3ef-430d-87bb-7865a26e746c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:12.620729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 307/627] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:12.621880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590cb37-4a73-451c-91b1-85632d60c4c0 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:12.683508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4410e20-eae7-41e2-992b-24089a2647a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:12.684646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410e20-eae7-41e2-992b-24089a2647a4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.684999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410e20-eae7-41e2-992b-24089a2647a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.685203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410e20-eae7-41e2-992b-24089a2647a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.716581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:12.737614 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3590cb37-4a73-451c-91b1-85632d60c4c0 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:12.740390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:12.755315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4410e20-eae7-41e2-992b-24089a2647a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:12.757014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4410e20-eae7-41e2-992b-24089a2647a4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:12.778490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:12.780020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.780307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.780585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.787681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:12.789203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:12.802672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:12.803709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:12.804735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 308/628] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:12.805243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:12.874222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 321/629] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:12.874222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a169df-ff24-4b10-961b-63fdd948703b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.874222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a169df-ff24-4b10-961b-63fdd948703b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.874222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a169df-ff24-4b10-961b-63fdd948703b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.874222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 322/630] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:12.874222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a169df-ff24-4b10-961b-63fdd948703b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:12.917978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f8ffc7-e321-43e2-b93d-36a6b246006b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:12.937133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:12.957246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdddba-0875-4d5b-bd2c-b0db40f826e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:12.958074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdddba-0875-4d5b-bd2c-b0db40f826e1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:12.958358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdddba-0875-4d5b-bd2c-b0db40f826e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:12.958633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdddba-0875-4d5b-bd2c-b0db40f826e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:12.969331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cdddba-0875-4d5b-bd2c-b0db40f826e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-e9cdddba-0875-4d5b-bd2c-b0db40f826e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:12.977030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:12.978019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:12.978858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 309/631] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:12.979568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdddba-0875-4d5b-bd2c-b0db40f826e1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:12.986439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a169df-ff24-4b10-961b-63fdd948703b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.010239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:13.024959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e4468-ea32-43fd-91ed-e4f0ad9a6515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.025634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4468-ea32-43fd-91ed-e4f0ad9a6515 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.025916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4468-ea32-43fd-91ed-e4f0ad9a6515 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.026187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4468-ea32-43fd-91ed-e4f0ad9a6515 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.026980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e4468-ea32-43fd-91ed-e4f0ad9a6515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:13.027292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e4468-ea32-43fd-91ed-e4f0ad9a6515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.028826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8e4468-ea32-43fd-91ed-e4f0ad9a6515 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.041234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 323/632] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:13.042472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445466ee-497f-4eee-9f7e-26c90ddade71 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.042759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445466ee-497f-4eee-9f7e-26c90ddade71 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.043031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445466ee-497f-4eee-9f7e-26c90ddade71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.060003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-445466ee-497f-4eee-9f7e-26c90ddade71 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:13.061293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-445466ee-497f-4eee-9f7e-26c90ddade71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:13.096582 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cdddba-0875-4d5b-bd2c-b0db40f826e1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.128493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 324/633] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:13.129755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445466ee-497f-4eee-9f7e-26c90ddade71 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.145306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.146447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.147151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.147583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.161861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.163366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:13.180983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:13.181911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:13.182850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:13.182850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:13.182850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:13.182850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:13.186693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:13.187406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 310/634] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:13.193023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.233991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445466ee-497f-4eee-9f7e-26c90ddade71 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.270414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:13.272094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.273000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.273331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.273613 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.274598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:13.274908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.276922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.292657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 325/635] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:13.292657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.293852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa031d9-ef5b-47b8-aee7-dc07eaebaedb None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.330877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe42c-909c-466c-8b54-959ff87d68a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.331964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe42c-909c-466c-8b54-959ff87d68a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.332106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe42c-909c-466c-8b54-959ff87d68a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.332363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51efe42c-909c-466c-8b54-959ff87d68a0 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/a57f6f39bba04a9d80a885340239cea3/roles/eb1899ecc6e0420f90de62e74998ca33` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.348162 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efe42c-909c-466c-8b54-959ff87d68a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=a57f6f39bba04a9d80a885340239cea3, role_id=eb1899ecc6e0420f90de62e74998ca33)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.349626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51efe42c-909c-466c-8b54-959ff87d68a0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.363646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 311/636] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:13 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/a57f6f39bba04a9d80a885340239cea3/roles/eb1899ecc6e0420f90de62e74998ca33 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:13.364565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe42c-909c-466c-8b54-959ff87d68a0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.423696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eee574-2dcf-4d19-896c-adf81fc68b5c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.449266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:13.474838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c987-9604-410c-a5b9-f81bdeb5f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.475706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c987-9604-410c-a5b9-f81bdeb5f2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.475990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c987-9604-410c-a5b9-f81bdeb5f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.476263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82c987-9604-410c-a5b9-f81bdeb5f2b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.488236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82c987-9604-410c-a5b9-f81bdeb5f2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:13.489458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51efe42c-909c-466c-8b54-959ff87d68a0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0b82c987-9604-410c-a5b9-f81bdeb5f2b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:13.496575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:13.497635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 326/637] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:13.499091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c987-9604-410c-a5b9-f81bdeb5f2b2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.525183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:13.537345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.538505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.538990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.539439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.540426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:13.541072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.542931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.556291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 312/638] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:13.557647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.634177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82c987-9604-410c-a5b9-f81bdeb5f2b2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.668732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffc939b-86bc-41b0-afa5-ee4cacd46d33 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.682859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.684005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.684638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.684946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.700106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.702357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.706478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.707278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.707711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.708084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.708940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:13.709399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.710910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.720294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 313/639] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:13.721208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:13.721570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:13.722468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:13.723360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:13.723360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:13.723360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:13.723360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:13.727682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 327/640] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:13.728389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.775051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:13.779355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:13.850043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85919e0a-48cf-4525-b548-172089e6e7ef None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.854252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31841d2f-0cad-4994-8f21-133502a61b0f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:13.889521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.890511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.890895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.891435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.895467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd53df-bccb-48cf-87d0-fb6a0b8234b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:13.896548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd53df-bccb-48cf-87d0-fb6a0b8234b7 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.896982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd53df-bccb-48cf-87d0-fb6a0b8234b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.897398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd53df-bccb-48cf-87d0-fb6a0b8234b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.904435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.906178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.906606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd53df-bccb-48cf-87d0-fb6a0b8234b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:13.908258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd53df-bccb-48cf-87d0-fb6a0b8234b7 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-93dd53df-bccb-48cf-87d0-fb6a0b8234b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:13.923646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:13.924617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:13.925508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:13.925508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:13.925508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:13.925508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:13.925508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:13.925508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:13.925508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:13.925508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:13.925932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:13.926721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:13.927711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:13.927711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:13.927711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:13.927711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:13.929706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 328/641] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:13.929883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 314/642] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:13.930673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:13.930935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357bc2e-f6bf-4204-9134-0ff893735ad0 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:13.931226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357bc2e-f6bf-4204-9134-0ff893735ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:13.931503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357bc2e-f6bf-4204-9134-0ff893735ad0 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:13.933085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 315/643] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:13.936558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357bc2e-f6bf-4204-9134-0ff893735ad0 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.018691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:14.038967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073f401-4520-4f34-a0ef-486baa44cd14 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.039909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357bc2e-f6bf-4204-9134-0ff893735ad0 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.050039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:14.076580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a869750-9e7c-4c8c-a189-c540c6d608f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.077753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a869750-9e7c-4c8c-a189-c540c6d608f0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.077871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.078364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a869750-9e7c-4c8c-a189-c540c6d608f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.078548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.078803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.079076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.079413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a869750-9e7c-4c8c-a189-c540c6d608f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.079892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:14.080199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.080788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a869750-9e7c-4c8c-a189-c540c6d608f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:14.081307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a869750-9e7c-4c8c-a189-c540c6d608f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.081636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.083254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a869750-9e7c-4c8c-a189-c540c6d608f0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.098003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 316/644] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:14.098003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.099885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 329/645] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:14.100827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785aff7-757c-4ecc-8870-aa5aaac29d66 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.101208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785aff7-757c-4ecc-8870-aa5aaac29d66 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.101490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785aff7-757c-4ecc-8870-aa5aaac29d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.117569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1785aff7-757c-4ecc-8870-aa5aaac29d66 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:14.118768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1785aff7-757c-4ecc-8870-aa5aaac29d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:14.190889 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 330/646] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:14.191685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785aff7-757c-4ecc-8870-aa5aaac29d66 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.222009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b22ae7-20b5-47af-843b-1cda8b6eeff5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.261168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.262418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.262700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.262973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.263752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:14.264057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.266056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.268299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:14.279804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 317/647] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:14.280500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.306472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785aff7-757c-4ecc-8870-aa5aaac29d66 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.311110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:14.341440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.342203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.342489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.342810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.343719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=6eb064e8062d4a4eb7a7974f7200c86f) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:14.344035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.345609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.351991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 331/648] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/role_assignments?user.id=6eb064e8062d4a4eb7a7974f7200c86f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:14.352807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.417252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef888a0-b59a-4195-bca0-9c935a7a2ab0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.471131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.472347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.472456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00e703-2abc-4789-bc92-0cf2bbb0d452 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.473248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.473692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.488239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.490888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:14.511576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:14.512862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 13:28:14.514020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:14.514686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ea02b-f35c-4a93-af6c-56fe2ef14392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.515258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea02b-f35c-4a93-af6c-56fe2ef14392 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.515626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea02b-f35c-4a93-af6c-56fe2ef14392 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.515970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ea02b-f35c-4a93-af6c-56fe2ef14392 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.516654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 318/649] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:14.517622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.518732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:14.535983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ea02b-f35c-4a93-af6c-56fe2ef14392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ae3ea02b-f35c-4a93-af6c-56fe2ef14392 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:14.546094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:14.547238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:14.548297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:14.550817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 332/650] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:14.551952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ea02b-f35c-4a93-af6c-56fe2ef14392 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.629598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:14.645579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3545467-f819-4290-9487-7c4d7ffdf5d6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.687837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ea02b-f35c-4a93-af6c-56fe2ef14392 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.689865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.691693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.691978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.692250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.701431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.703041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:14.721901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:14.722933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:14.723956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 319/651] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:14.725128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.725198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.727632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.727632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.727632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.727632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:14.728769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.730286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.753705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 333/652] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:14.754668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.813734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:14.848960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c1d3a-f84d-426e-b8e9-68ad200c0b13 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.864248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ee9c5-09e9-4c27-ae81-b637ec1d3af5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:14.886148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.886857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.887753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.888037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.888795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:14.889107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.890675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.898145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:14.898824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:14.899102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:14.899367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:14.900245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:14.900554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:14.901979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:14.903869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 320/653] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:14.904991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:14.919492 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:14.921349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 334/654] 10.222.0.64 () {56 vars in 1137 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:14.922042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.024508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c56973-77e6-40f4-8904-36aa3472492a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.025116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54399d7-8fa2-42d9-a34c-dca7809f3371 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.040039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:15.067019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a034e2-1c70-44fb-8363-278b377bcb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.067726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a034e2-1c70-44fb-8363-278b377bcb5b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.068015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a034e2-1c70-44fb-8363-278b377bcb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.068263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.068384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a034e2-1c70-44fb-8363-278b377bcb5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.069379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.069847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.070301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.083667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.086179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:15.109105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:15.110040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:15.110911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:15.110911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:15.110911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:15.110911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:15.117778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 335/655] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:15.117778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.156077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a034e2-1c70-44fb-8363-278b377bcb5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.157901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a034e2-1c70-44fb-8363-278b377bcb5b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.173708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:15.225048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45297777-5d5b-4ba5-b943-1936ec1cf9f0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.263289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c92c2-a58a-4981-921d-641cd5c627b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.264104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c92c2-a58a-4981-921d-641cd5c627b0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.264479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c92c2-a58a-4981-921d-641cd5c627b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.264845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c92c2-a58a-4981-921d-641cd5c627b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.279378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 321/656] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:15.280609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a034e2-1c70-44fb-8363-278b377bcb5b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.302639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:15.346962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c92c2-a58a-4981-921d-641cd5c627b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.348658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c92c2-a58a-4981-921d-641cd5c627b0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.379222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a034e2-1c70-44fb-8363-278b377bcb5b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.391198 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:15.415218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.416260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.416733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.417191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.418113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:15.418739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.420330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.436597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 322/657] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:15.437781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.463134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 336/658] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:15.463134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c92c2-a58a-4981-921d-641cd5c627b0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.524899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:15.542758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0000af19-82ca-4301-91d0-fcb0ebdea2d8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.568662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c92c2-a58a-4981-921d-641cd5c627b0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.576214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.577028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.577304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.577573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.588327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.589771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.605449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3466c-9373-4813-90e5-e6336a8e83e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.606400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3466c-9373-4813-90e5-e6336a8e83e7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.606742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3466c-9373-4813-90e5-e6336a8e83e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.606965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3466c-9373-4813-90e5-e6336a8e83e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:15.607838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:15.608706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:15.609609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:15.609609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:15.609609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:15.609609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:15.609609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 323/659] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:15.609892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.617291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3466c-9373-4813-90e5-e6336a8e83e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.618755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3466c-9373-4813-90e5-e6336a8e83e7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-caa3466c-9373-4813-90e5-e6336a8e83e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:15.634724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:15.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:15.636762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 337/660] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:15.637457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221285-eba1-457b-82ae-8ce89e5957a6 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.638295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221285-eba1-457b-82ae-8ce89e5957a6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.638295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce221285-eba1-457b-82ae-8ce89e5957a6 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.643453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 338/661] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:15.643453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce221285-eba1-457b-82ae-8ce89e5957a6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.653205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:15.736139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf56b8a-db7d-4b88-938e-31e1bfaed70e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.746930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce221285-eba1-457b-82ae-8ce89e5957a6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.769992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d0a612-ce2e-492c-a87a-87703defe0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.771040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0a612-ce2e-492c-a87a-87703defe0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.771320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0a612-ce2e-492c-a87a-87703defe0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.771588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d0a612-ce2e-492c-a87a-87703defe0d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.771725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:15.782874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0a612-ce2e-492c-a87a-87703defe0d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.784356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d0a612-ce2e-492c-a87a-87703defe0d7 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.786539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.787660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.788092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.788533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.789415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:15.789865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.791787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a1d0a612-ce2e-492c-a87a-87703defe0d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:15.800955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:15.801982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:15.803197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:15.803197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:15.803197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:15.803197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:15.806690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 324/662] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:15.806912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 339/663] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:15.807871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.807993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6e71-0e10-43e3-9163-72638d29215f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.808280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6e71-0e10-43e3-9163-72638d29215f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.808558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6e71-0e10-43e3-9163-72638d29215f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.826933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-133f6e71-0e10-43e3-9163-72638d29215f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:15.828164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-133f6e71-0e10-43e3-9163-72638d29215f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:15.897621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 325/664] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:15.898431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f6e71-0e10-43e3-9163-72638d29215f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:15.915795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:15.930480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c6418-5af1-4f23-a00f-7b0340fc8187 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:15.965460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:15.966161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:15.966441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:15.966713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:15.967816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:15.967921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:15.969338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:15.988224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 340/665] 10.222.0.64 () {56 vars in 1139 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:15.993300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.017953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f6e71-0e10-43e3-9163-72638d29215f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.036579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.054950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.055658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.055926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.056202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.056956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:16.057261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.058643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.070212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 326/666] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:16.071018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.101523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eceafac-c89c-4522-b6a9-63009e2e7e2d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.132001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.137301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.138332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.138679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.138952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.145852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.147292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:16.160727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:16.161647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:16.162610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 341/667] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:16.163093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.177318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff73e38f-c238-4a5f-ade5-184af1e016c5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.212380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f299c1-d5de-4815-b4b1-0b98d7d270ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.213271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f299c1-d5de-4815-b4b1-0b98d7d270ee None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.213551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f299c1-d5de-4815-b4b1-0b98d7d270ee None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.213833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f299c1-d5de-4815-b4b1-0b98d7d270ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.224508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f299c1-d5de-4815-b4b1-0b98d7d270ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-66f299c1-d5de-4815-b4b1-0b98d7d270ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:16.232470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:16.233367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 327/668] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:16.235083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f299c1-d5de-4815-b4b1-0b98d7d270ee None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.272670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.276103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0404cb-4d07-4a4c-89d4-87dfd69cfc2e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.318025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b6ef5-25ce-4e96-83df-2f4dbff1bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.319009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b6ef5-25ce-4e96-83df-2f4dbff1bb56 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.319300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b6ef5-25ce-4e96-83df-2f4dbff1bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.319777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b6ef5-25ce-4e96-83df-2f4dbff1bb56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.340932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f299c1-d5de-4815-b4b1-0b98d7d270ee None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.365538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.377368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.378382 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.378792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.379204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.386537 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.388121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.389356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b6ef5-25ce-4e96-83df-2f4dbff1bb56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.390807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b6ef5-25ce-4e96-83df-2f4dbff1bb56 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:16.402313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:16.403235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:16.404153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 328/669] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:16.404635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.498575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.503144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 342/670] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:16.504194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b6ef5-25ce-4e96-83df-2f4dbff1bb56 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.517196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d7d816-143e-4c2e-b463-502b059eaabd None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.551378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.552009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.552288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.552563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.553366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:16.553673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.555108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.567132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 329/671] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:16.567985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.601472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b6ef5-25ce-4e96-83df-2f4dbff1bb56 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.614090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.638762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.639467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.639804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.640076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.640893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:16.641204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.642597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.651366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 343/672] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:16.652846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.676453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df3fb2-b6df-4101-ad3a-e0d0c4bc9301 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.711161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029eddb-3c44-47e1-aaf4-3dbcd615ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.711873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029eddb-3c44-47e1-aaf4-3dbcd615ce81 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.712164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029eddb-3c44-47e1-aaf4-3dbcd615ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.712461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029eddb-3c44-47e1-aaf4-3dbcd615ce81 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.713297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029eddb-3c44-47e1-aaf4-3dbcd615ce81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:16.713603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029eddb-3c44-47e1-aaf4-3dbcd615ce81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.714467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.715055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029eddb-3c44-47e1-aaf4-3dbcd615ce81 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.727164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 330/673] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:16.728475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c323ea9-2b4a-4ad9-8a6c-a09c5f0b2299 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.728761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c323ea9-2b4a-4ad9-8a6c-a09c5f0b2299 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.729039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c323ea9-2b4a-4ad9-8a6c-a09c5f0b2299 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.730256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 331/674] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:16.730977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c323ea9-2b4a-4ad9-8a6c-a09c5f0b2299 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.758082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26439d17-cb36-487d-ae2d-6f81d74dfa66 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.791338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.792194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.792460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.792790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.802910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.804317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:16.821981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:16.822866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:16.823827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:16.823827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:16.823827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:16.823827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:16.823827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 344/675] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:16.824099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.838268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c323ea9-2b4a-4ad9-8a6c-a09c5f0b2299 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.840848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.874681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.875383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.875687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.875961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:16.876832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=b1dd830b8f7846e78d8f007ac436d95b) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:16.877145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:16.878638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:16.884553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 332/676] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/role_assignments?user.id=b1dd830b8f7846e78d8f007ac436d95b&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:16.885380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:16.933131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c52cb4e-c321-4c96-bc66-c3bee449c393 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:16.950351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:16.976664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c79489-e73b-47bf-948a-28db1a814e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:16.977883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79489-e73b-47bf-948a-28db1a814e0c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:16.978568 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79489-e73b-47bf-948a-28db1a814e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:16.979037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c79489-e73b-47bf-948a-28db1a814e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.000697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c79489-e73b-47bf-948a-28db1a814e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.002930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c79489-e73b-47bf-948a-28db1a814e0c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.016445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5ead3-2157-4f15-8004-4f20d891700a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-85c79489-e73b-47bf-948a-28db1a814e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:17.024187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:17.025167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:17.026095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:17.026095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:17.026095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:17.026095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:17.026095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 345/677] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:17.027485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcebb5-c85f-40d0-9310-5204aa49aa19 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.027485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcebb5-c85f-40d0-9310-5204aa49aa19 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.027485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcebb5-c85f-40d0-9310-5204aa49aa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.045124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cffcebb5-c85f-40d0-9310-5204aa49aa19 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:17.046350 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cffcebb5-c85f-40d0-9310-5204aa49aa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:17.063936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.064920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.064920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.065108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.066049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=1df6ff57287645b2ae6f3b68543d6fbf) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:17.066369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.067876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.075931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 333/678] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:16 2022] GET /identity/v3/role_assignments?user.id=1df6ff57287645b2ae6f3b68543d6fbf&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:17.076850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.125369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:17.131953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 346/679] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:17.133014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcebb5-c85f-40d0-9310-5204aa49aa19 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.218525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18659031-4aba-464c-bb8b-5558f625696b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.262386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.263087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.263729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.264015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.264936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:17.265249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.267055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.269886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:17.275099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcebb5-c85f-40d0-9310-5204aa49aa19 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.286070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 334/680] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:17.287308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.317232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.317917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.318198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.318472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.319206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:17.319513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.320915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.341337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 347/681] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:17.342560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.403868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:17.416088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328ed0b-797d-44e1-abe5-9b45c8637985 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.458853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cbbaf-6c2d-4c86-8e65-1f9cc9dfbc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.459690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cbbaf-6c2d-4c86-8e65-1f9cc9dfbc69 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.460115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cbbaf-6c2d-4c86-8e65-1f9cc9dfbc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.460396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cbbaf-6c2d-4c86-8e65-1f9cc9dfbc69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.471636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e5c47-97ce-4770-9119-4d2c05217a37 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.474948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cbbaf-6c2d-4c86-8e65-1f9cc9dfbc69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-d17cbbaf-6c2d-4c86-8e65-1f9cc9dfbc69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:17.484086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:17.485266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:17.486346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:17.488926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 335/682] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:17.488926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cbbaf-6c2d-4c86-8e65-1f9cc9dfbc69 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.519285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.520508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.521045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.521324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.530560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.532547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:17.552713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:17.554189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:17.555777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:17.555777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:17.555777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:17.555777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:17.555777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:17.555777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:17.555777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:17.555777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:17.559563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 348/683] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:17.560649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.583853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:17.600279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cbbaf-6c2d-4c86-8e65-1f9cc9dfbc69 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.636403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.637558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.637896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.638462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.647544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.649200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:17.671207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:17.672229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:17.673150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:17.680232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 336/684] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:17.681383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.689230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34371be-80e4-49c0-8591-db7a10b81e6f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.698939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:17.727702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.728459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.728747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.729021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.729783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:17.730089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.731745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.745604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 349/685] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:17.746526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.793589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6dcf99-c319-4702-9ec6-d48525e9ba39 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.829347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:17.832567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.834500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.835056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.835520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.836741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:17.837237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.838898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.852078 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f2ff35-f2fd-4eac-8ad5-775ba1c4497a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.853022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 337/686] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:17.854135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.891876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:17.892628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:17.892911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:17.893186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:17.894096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:17.894409 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:17.895883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:17.914377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 350/687] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:17.915568 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:17.963568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca8636-61a2-486d-a2d0-afb1db9098e8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:17.972348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.000511 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.001867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.002353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.002826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.014642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.016388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.016520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6152b4c4-ce25-471a-a7b6-797a454d256a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:18.035677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:18.036607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:18.037514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:18.037514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:18.037514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:18.037514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:18.043711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 338/688] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:18.043711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:18.057263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.057936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.058215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.058488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.059765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=bcdda7fcb39248c1a5a36ee699d23c73) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:18.060081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.061616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.064667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.068506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 351/689] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:17 2022] GET /identity/v3/role_assignments?user.id=bcdda7fcb39248c1a5a36ee699d23c73&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:18.069466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:18.159888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661dead-3e8f-4481-a8eb-cfd50c548be6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.182461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d37d8-abf0-4ee3-9ef8-24267a47a39a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.189192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.200809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7fa8-2f1d-4939-b994-cc339bab29ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.201968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7fa8-2f1d-4939-b994-cc339bab29ee None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.202545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7fa8-2f1d-4939-b994-cc339bab29ee None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.203026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a7fa8-2f1d-4939-b994-cc339bab29ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.221268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.221954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.222236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.222513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.223254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:18.223560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.225274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.239943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 352/690] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:18.245534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:18.282452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a7fa8-2f1d-4939-b994-cc339bab29ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.284616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a7fa8-2f1d-4939-b994-cc339bab29ee None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.310662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.356371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f033c170-e9f5-451f-906b-5bd489d541e0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.393339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.394172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.394491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.394762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.406117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.406117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.406583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 339/691] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:18.408457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7fa8-2f1d-4939-b994-cc339bab29ee None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:18.422636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:18.423687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:18.425376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 353/692] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:18.429818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:18.441540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.521242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a7fa8-2f1d-4939-b994-cc339bab29ee None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.554373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64421971-8a98-41d5-9a7f-c8fe8ed2ab76 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.557189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.558256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.558736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.559257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.570609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.572632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.575770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.591341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.592051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.592334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.592610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.593460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:18.593769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.595250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:18.596584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:18.597502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:18.598403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:18.598403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:18.598403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:18.598403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:18.603546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 340/693] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:18.606743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:18.614686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 354/694] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:18.620256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:18.699924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.725154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e71a1-3bc0-48f3-9f2b-e58bac8fc222 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.726346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc2ff0-639f-4807-a9d0-1f438d99398b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.762096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902cc82-f42f-4150-aa9c-e46b8cfa8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.762702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.762826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902cc82-f42f-4150-aa9c-e46b8cfa8d98 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.763075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902cc82-f42f-4150-aa9c-e46b8cfa8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.763356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9902cc82-f42f-4150-aa9c-e46b8cfa8d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.764134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.764625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.765088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.766100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:18.766619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.768289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.785414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 341/695] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:18.787056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:18.852736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.892014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998a985-5426-4e1a-8806-fc463eee3b54 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:18.925941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902cc82-f42f-4150-aa9c-e46b8cfa8d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.927296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:18.927537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9902cc82-f42f-4150-aa9c-e46b8cfa8d98 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.928575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:18.929057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:18.929559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:18.939965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:18.946012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:18.947776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:18.975522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:18.976487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:18.977387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:18.977387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:18.977387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:18.977387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:18.977387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:18.977387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:18.977387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:18.977387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:18.987652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 342/696] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:18.989847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.111170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 355/697] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:19.116968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902cc82-f42f-4150-aa9c-e46b8cfa8d98 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.128284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcdc9cf-776a-4efb-8727-9a86915e70bb None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:19.172347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:19.173406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.173911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.174410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.175425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:19.175958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:19.177612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:19.206228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 343/698] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:19.212224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.212987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:19.252422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9902cc82-f42f-4150-aa9c-e46b8cfa8d98 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:19.315506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8371d23-d5e1-43ad-a520-4ce9e67c8cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:19.316341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371d23-d5e1-43ad-a520-4ce9e67c8cba None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.316620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371d23-d5e1-43ad-a520-4ce9e67c8cba None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.316885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8371d23-d5e1-43ad-a520-4ce9e67c8cba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.318738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:19.337305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8371d23-d5e1-43ad-a520-4ce9e67c8cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:19.338811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8371d23-d5e1-43ad-a520-4ce9e67c8cba None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a8371d23-d5e1-43ad-a520-4ce9e67c8cba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:19.366369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:19.367336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:19.368670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:19.368670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:19.368670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:19.368670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:19.368670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 356/699] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:19.369188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512bbd-c70d-4395-9881-34e4dffc21a3 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.369468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512bbd-c70d-4395-9881-34e4dffc21a3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.369741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10512bbd-c70d-4395-9881-34e4dffc21a3 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.371222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 357/700] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:19.373635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512bbd-c70d-4395-9881-34e4dffc21a3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.385104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72d526-0367-4215-b649-42ea8ee77a69 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:19.423044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba9fee-8b03-4613-b8e0-9129f93df829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:19.423767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9fee-8b03-4613-b8e0-9129f93df829 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.424084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9fee-8b03-4613-b8e0-9129f93df829 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.424288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba9fee-8b03-4613-b8e0-9129f93df829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.425125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba9fee-8b03-4613-b8e0-9129f93df829 None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=a57f6f39bba04a9d80a885340239cea3) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:19.425525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba9fee-8b03-4613-b8e0-9129f93df829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:19.426889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba9fee-8b03-4613-b8e0-9129f93df829 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:19.433283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 344/701] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:19 2022] GET /identity/v3/role_assignments?user.id=a57f6f39bba04a9d80a885340239cea3&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:19.434978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5181d-e3d0-4816-9e11-f40f9f8ace3b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.435260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5181d-e3d0-4816-9e11-f40f9f8ace3b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.435534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5181d-e3d0-4816-9e11-f40f9f8ace3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.463521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7cb5181d-e3d0-4816-9e11-f40f9f8ace3b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:19.465323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7cb5181d-e3d0-4816-9e11-f40f9f8ace3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:19.496393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10512bbd-c70d-4395-9881-34e4dffc21a3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:19.531186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:19.541467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c2c14-cc3c-4ccc-9703-28d3ace3ca08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:19.542892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2c14-cc3c-4ccc-9703-28d3ace3ca08 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.543712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2c14-cc3c-4ccc-9703-28d3ace3ca08 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.544196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c2c14-cc3c-4ccc-9703-28d3ace3ca08 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.545634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c2c14-cc3c-4ccc-9703-28d3ace3ca08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:19.546203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c2c14-cc3c-4ccc-9703-28d3ace3ca08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:19.548487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66c2c14-cc3c-4ccc-9703-28d3ace3ca08 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:19.565761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 358/702] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:19.567573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b297-e8f9-4ebd-8b2e-0985a10082d8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.567979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 345/703] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:19.568342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b297-e8f9-4ebd-8b2e-0985a10082d8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.568818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20b297-e8f9-4ebd-8b2e-0985a10082d8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.570884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 359/704] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:19.575338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5181d-e3d0-4816-9e11-f40f9f8ace3b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.577167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb8fa-eaa6-4967-947d-d8ab71de6bfa None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.577674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb8fa-eaa6-4967-947d-d8ab71de6bfa None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.578149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ceb8fa-eaa6-4967-947d-d8ab71de6bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.598311 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-14ceb8fa-eaa6-4967-947d-d8ab71de6bfa None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:19.599522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-14ceb8fa-eaa6-4967-947d-d8ab71de6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:19.645793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:19.698307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 360/705] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:19.699747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb8fa-eaa6-4967-947d-d8ab71de6bfa None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.707339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5181d-e3d0-4816-9e11-f40f9f8ace3b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:19.760423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:19.761621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.761944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.762230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.771623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:19.773606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:19.792044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:19.793001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:19.793934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:19.793934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:19.793934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:19.793934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:19.793934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:19.793934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:19.793934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:19.793934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:19.794373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 346/706] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:19.799510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.823714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ceb8fa-eaa6-4967-947d-d8ab71de6bfa None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:19.847938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:19.867963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:19.868827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.869113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.869494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.870171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:19.871756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:19.887152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:19.888399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:19.889247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 361/707] 10.222.0.64 () {56 vars in 1129 bytes} [Tue Jul 12 13:28:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:19.890069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.922743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed1426-91f2-4ddc-b26e-a2d356252adc None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:19.934246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:19.959020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:19.960219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:19.960697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:19.961182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:19.972165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:19.973940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:19.991576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:19.992529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:19.993417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:19.993417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:19.993417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:19.993417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:19.995670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 347/708] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:19.996691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:19.999810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a809e-2016-4992-a9ba-f6cc48fc5735 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:20.040468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:20.041320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:20.041667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:20.042117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:20.042932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:20.043304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:20.044917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:20.058305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 362/709] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:20.059256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:20.108227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:20.118404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f590e0f-e441-4e8a-bb56-b0ca2756da28 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:20.161631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:20.162586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:20.162874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:20.163154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:20.164189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:20.164874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:20.166790 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:20.170661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a85ea-6eb2-46d8-8c50-0a5231ad3e4b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:20.173824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 348/710] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 12 13:28:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:20.174663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:20.207419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:20.208138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:20.208422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:20.208697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:20.209436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:20.209746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:20.210064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:20.211132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:20.228777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 363/711] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:20.229682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:20.306228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abcedd-fb6f-4a8a-a4b2-2b18e777a337 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:20.338552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198724a9-5b87-4bdc-a10a-bcf1ed7cba20 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:20.342051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:20.353156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:20.354260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:20.354816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:20.355089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:20.356360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=6eb064e8062d4a4eb7a7974f7200c86f) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:20.356680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:20.358960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:20.367115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 349/712] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:20 2022] GET /identity/v3/role_assignments?user.id=6eb064e8062d4a4eb7a7974f7200c86f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:20.369355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:20.399367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59735ad8-82b0-4455-990f-0bce1731b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:20.400104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735ad8-82b0-4455-990f-0bce1731b939 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:20.400392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735ad8-82b0-4455-990f-0bce1731b939 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:20.402395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59735ad8-82b0-4455-990f-0bce1731b939 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:20.403356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735ad8-82b0-4455-990f-0bce1731b939 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:20.403699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735ad8-82b0-4455-990f-0bce1731b939 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:20.406039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59735ad8-82b0-4455-990f-0bce1731b939 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:20.417806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 364/713] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 12 13:28:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:20.552111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:20.564815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d5756-a019-40d1-98a0-933ce87b7afa None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:20.605839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6893aa-6a1b-48b6-b938-abe1d90a9abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:20.607003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6893aa-6a1b-48b6-b938-abe1d90a9abb None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:20.607546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6893aa-6a1b-48b6-b938-abe1d90a9abb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:20.608056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6893aa-6a1b-48b6-b938-abe1d90a9abb None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:20.609027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6893aa-6a1b-48b6-b938-abe1d90a9abb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:20.610761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6893aa-6a1b-48b6-b938-abe1d90a9abb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:20.635214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 350/714] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:28:20 2022] POST /identity/v3/users => generated 254 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:20.812558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6d82c-df65-4b78-aa35-98496aa19291 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:20.812983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6d82c-df65-4b78-aa35-98496aa19291 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:20.813173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f6d82c-df65-4b78-aa35-98496aa19291 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:20.814923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 365/715] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:20.820792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998bb2c-f05b-47ba-b389-d3f20cf4be32 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:20.821109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998bb2c-f05b-47ba-b389-d3f20cf4be32 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:20.821343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998bb2c-f05b-47ba-b389-d3f20cf4be32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:20.844771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-9998bb2c-f05b-47ba-b389-d3f20cf4be32 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:20.846074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9998bb2c-f05b-47ba-b389-d3f20cf4be32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:20.923111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 351/716] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:20.945983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6d82c-df65-4b78-aa35-98496aa19291 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:21.057557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f6d82c-df65-4b78-aa35-98496aa19291 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:21.092790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:21.093614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:21.093898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:21.094300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] PATH_INFO: `/v3/services/network` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:21.095044 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:21.096456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:21.108577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:21.109587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:21.110466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 366/717] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:20 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:21.117595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998bb2c-f05b-47ba-b389-d3f20cf4be32 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:21.234209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:21.264925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998bb2c-f05b-47ba-b389-d3f20cf4be32 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:21.310281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad2489-9c14-4ebf-9573-4ce0425ce3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:21.310964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2489-9c14-4ebf-9573-4ce0425ce3fa None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:21.311247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2489-9c14-4ebf-9573-4ce0425ce3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:21.311523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad2489-9c14-4ebf-9573-4ce0425ce3fa None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:21.312269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2489-9c14-4ebf-9573-4ce0425ce3fa None admin] RBAC: Adding query filter params (name=network) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:21.312578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2489-9c14-4ebf-9573-4ce0425ce3fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:21.314021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ad2489-9c14-4ebf-9573-4ce0425ce3fa None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:21.323807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 352/718] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:21.329314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:21.381418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:21.458999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d65458-f2bb-49af-ab88-95d677c5d960 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:21.499188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd4742-7492-4095-9fa9-eb9d68a77901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:21.499905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4742-7492-4095-9fa9-eb9d68a77901 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:21.500196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4742-7492-4095-9fa9-eb9d68a77901 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:21.500478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4742-7492-4095-9fa9-eb9d68a77901 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:21.501210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd4742-7492-4095-9fa9-eb9d68a77901 None admin] RBAC: Adding query filter params (type=network) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:21.501520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd4742-7492-4095-9fa9-eb9d68a77901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:21.502911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd4742-7492-4095-9fa9-eb9d68a77901 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:21.507976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 367/719] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:21 2022] GET /identity/v3/services?type=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:22.094253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149523c-d014-44da-8708-9e0d959b3057 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:22.095350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149523c-d014-44da-8708-9e0d959b3057 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:22.095876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e149523c-d014-44da-8708-9e0d959b3057 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:22.097719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 353/720] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:22.103052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2d7b-4eb6-46a9-a6af-ad4223e2e147 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:22.103897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2d7b-4eb6-46a9-a6af-ad4223e2e147 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:22.104506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a2d7b-4eb6-46a9-a6af-ad4223e2e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:22.121982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2f9a2d7b-4eb6-46a9-a6af-ad4223e2e147 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:22.123476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2f9a2d7b-4eb6-46a9-a6af-ad4223e2e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:22.195341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 368/721] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:22.218643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149523c-d014-44da-8708-9e0d959b3057 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:22.327320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e149523c-d014-44da-8708-9e0d959b3057 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:22.366143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b002d79-11b0-419a-a67f-e815fd0bb042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:22.367318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002d79-11b0-419a-a67f-e815fd0bb042 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:22.367889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002d79-11b0-419a-a67f-e815fd0bb042 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:22.368408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002d79-11b0-419a-a67f-e815fd0bb042 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:22.376804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:22.381727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b002d79-11b0-419a-a67f-e815fd0bb042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-1b002d79-11b0-419a-a67f-e815fd0bb042 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:22.389821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:22.390837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:22.391750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:22.394545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 354/722] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:22.400585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2d7b-4eb6-46a9-a6af-ad4223e2e147 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:22.427986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:22.503356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a2d7b-4eb6-46a9-a6af-ad4223e2e147 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:22.538663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:22.539357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:22.539668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:22.539950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:22.540713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:22.541035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:22.542402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:22.551550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 369/723] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:22.558621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b002d79-11b0-419a-a67f-e815fd0bb042 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:22.666844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b002d79-11b0-419a-a67f-e815fd0bb042 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:22.704636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:22.705722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:22.706174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:22.706602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:22.718626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:22.720356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:22.738099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:22.739236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:22.740474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:22.740474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:22.740474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:22.740474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:22.742376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 355/724] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:22.748356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:22.837493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:22.850321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e15fb0-2d96-4e0e-908c-d4ac5f4330a3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:22.884490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbc9163-b627-447a-a32d-366b7b9b7a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:22.885178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9163-b627-447a-a32d-366b7b9b7a9c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:22.885481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9163-b627-447a-a32d-366b7b9b7a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:22.885767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbc9163-b627-447a-a32d-366b7b9b7a9c None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:22.886553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc9163-b627-447a-a32d-366b7b9b7a9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:22.886892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc9163-b627-447a-a32d-366b7b9b7a9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:22.888371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbc9163-b627-447a-a32d-366b7b9b7a9c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:22.901208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 370/725] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:22.909972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:22.982702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:23.034285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a02a5f3-7fe2-442c-989a-d20a62cba07a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:23.051809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a7ea2-64fc-477c-be74-b40f7333b242 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.052664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a7ea2-64fc-477c-be74-b40f7333b242 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.053477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a7ea2-64fc-477c-be74-b40f7333b242 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.055316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 371/726] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:23.061001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7b0e-1edd-430c-8664-ab76886770cf None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.061567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7b0e-1edd-430c-8664-ab76886770cf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.062043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cded7b0e-1edd-430c-8664-ab76886770cf None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.063801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 372/727] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:23.065134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368afb71-ef72-49dd-92db-d0adfb4ba763 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.065647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368afb71-ef72-49dd-92db-d0adfb4ba763 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.066124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368afb71-ef72-49dd-92db-d0adfb4ba763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.073796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0671fa-97ef-406b-b3fd-990dd77884c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:23.074793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0671fa-97ef-406b-b3fd-990dd77884c4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.075077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0671fa-97ef-406b-b3fd-990dd77884c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.075350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0671fa-97ef-406b-b3fd-990dd77884c4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.083271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0671fa-97ef-406b-b3fd-990dd77884c4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:23.084750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0671fa-97ef-406b-b3fd-990dd77884c4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:23.085158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-368afb71-ef72-49dd-92db-d0adfb4ba763 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:23.086663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-368afb71-ef72-49dd-92db-d0adfb4ba763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ec0671fa-97ef-406b-b3fd-990dd77884c4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:23.099179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:23.100574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:23.101553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 356/728] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:23.102147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1d9d-d242-40dc-a17d-6c5b20bc6de0 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.102775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1d9d-d242-40dc-a17d-6c5b20bc6de0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.102775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c1d9d-d242-40dc-a17d-6c5b20bc6de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.120618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-460c1d9d-d242-40dc-a17d-6c5b20bc6de0 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:23.121876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-460c1d9d-d242-40dc-a17d-6c5b20bc6de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:23.171623 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 373/729] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:23.173331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368afb71-ef72-49dd-92db-d0adfb4ba763 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:23.191105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 357/730] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:23.212973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c1d9d-d242-40dc-a17d-6c5b20bc6de0 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:23.257879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:23.272777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:23.296863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368afb71-ef72-49dd-92db-d0adfb4ba763 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:23.325443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c1d9d-d242-40dc-a17d-6c5b20bc6de0 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:23.333375 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:23.334286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.334758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.335273 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.336366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:23.336967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:23.338598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:23.359569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 374/731] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 12 13:28:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:23.360762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:23.361448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d906df-dde3-4f48-8a04-817081cafd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:23.362145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d906df-dde3-4f48-8a04-817081cafd6f None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.362420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d906df-dde3-4f48-8a04-817081cafd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.362739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d906df-dde3-4f48-8a04-817081cafd6f None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.363479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d906df-dde3-4f48-8a04-817081cafd6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:23.365086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d906df-dde3-4f48-8a04-817081cafd6f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:23.384007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 358/732] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:28:23 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:28:23.384876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d906df-dde3-4f48-8a04-817081cafd6f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:23.502338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b02bf1-ccae-4a56-824a-da71b347de9b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:23.512712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:23.521061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d906df-dde3-4f48-8a04-817081cafd6f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:23.555421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a4993-6ca3-4361-aecb-9bd9cce3fffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:23.556092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4993-6ca3-4361-aecb-9bd9cce3fffa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.556379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4993-6ca3-4361-aecb-9bd9cce3fffa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.557374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a4993-6ca3-4361-aecb-9bd9cce3fffa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.561989 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:23.571022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e73415-552e-40c9-8e66-35dd5a4d66da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:23.571353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a4993-6ca3-4361-aecb-9bd9cce3fffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:23.572504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73415-552e-40c9-8e66-35dd5a4d66da None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.572504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73415-552e-40c9-8e66-35dd5a4d66da None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.572504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e73415-552e-40c9-8e66-35dd5a4d66da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-5d5a4993-6ca3-4361-aecb-9bd9cce3fffa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:23.579635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:23.580586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:23.581431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 375/733] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:23.587467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439289c2-92db-475a-a2c5-e780de9ec3e0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.587467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439289c2-92db-475a-a2c5-e780de9ec3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.587467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439289c2-92db-475a-a2c5-e780de9ec3e0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.587467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 376/734] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:23.587915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439289c2-92db-475a-a2c5-e780de9ec3e0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:23.657698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73415-552e-40c9-8e66-35dd5a4d66da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:23.659482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e73415-552e-40c9-8e66-35dd5a4d66da None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:23.737287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439289c2-92db-475a-a2c5-e780de9ec3e0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:23.761499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:23.771656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 359/735] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 13:28:23.773401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6ddf1-34fa-40aa-9c7f-4501b8d40169 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.773897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6ddf1-34fa-40aa-9c7f-4501b8d40169 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.774384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6ddf1-34fa-40aa-9c7f-4501b8d40169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.785145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:23.785974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.786357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.786729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.788235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:23.788676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:23.790480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:23.793954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-28b6ddf1-34fa-40aa-9c7f-4501b8d40169 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:23.795314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-28b6ddf1-34fa-40aa-9c7f-4501b8d40169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:23.805531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 377/736] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:23.805531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:23.871120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:23.891655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 360/737] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:23.891655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6ddf1-34fa-40aa-9c7f-4501b8d40169 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:23.926030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d59a6-19ef-4ff3-b370-922d235be64d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:23.962125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:23.963365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:23.963876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:23.964330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:23.975659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:23.977385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:23.995086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:23.996293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:23.997224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:23.997224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:23.997224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:23.997224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:24.003865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 378/738] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:24.005121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.005550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6ddf1-34fa-40aa-9c7f-4501b8d40169 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.035649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:24.045863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.046693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.046976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.047251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.059191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.061103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:24.081865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:24.082785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:24.083698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:24.083698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:24.083698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:24.083698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:24.083698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 361/739] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:24.084416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.115727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ad7f1-dc97-47d3-a7ce-b6065c73e229 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.128069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:24.157583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a860d-1ee0-4b75-8b21-0ce4b5ae2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.158399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a860d-1ee0-4b75-8b21-0ce4b5ae2a45 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.158693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a860d-1ee0-4b75-8b21-0ce4b5ae2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.159209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168a860d-1ee0-4b75-8b21-0ce4b5ae2a45 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.171650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168a860d-1ee0-4b75-8b21-0ce4b5ae2a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-168a860d-1ee0-4b75-8b21-0ce4b5ae2a45 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:24.179387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:24.180680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:24.181651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 379/740] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:24.182375 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a860d-1ee0-4b75-8b21-0ce4b5ae2a45 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.203791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b68ad-5f01-4c19-b08b-1f2da1f30680 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.241428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e167512-e75b-4904-80a2-f862fdb6ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.242848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e167512-e75b-4904-80a2-f862fdb6ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.243284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e167512-e75b-4904-80a2-f862fdb6ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.243566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e167512-e75b-4904-80a2-f862fdb6ffe0 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.244332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e167512-e75b-4904-80a2-f862fdb6ffe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:24.244643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e167512-e75b-4904-80a2-f862fdb6ffe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.246039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e167512-e75b-4904-80a2-f862fdb6ffe0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.262384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 362/741] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:24.262384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ec72-fdf8-45e4-9453-72c94f9a7620 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.262384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ec72-fdf8-45e4-9453-72c94f9a7620 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.262384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8ec72-fdf8-45e4-9453-72c94f9a7620 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.262384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 363/742] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:24.262384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ec72-fdf8-45e4-9453-72c94f9a7620 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.300103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168a860d-1ee0-4b75-8b21-0ce4b5ae2a45 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.310563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:24.336934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.337624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.337910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.338204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.338929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:24.339241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.340709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.354615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 380/743] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:24.355432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.382181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8ec72-fdf8-45e4-9453-72c94f9a7620 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.386740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:24.418358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c57374c-1401-4058-9644-7677add7195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.419044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57374c-1401-4058-9644-7677add7195c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.419331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57374c-1401-4058-9644-7677add7195c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.419634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57374c-1401-4058-9644-7677add7195c None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.420386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57374c-1401-4058-9644-7677add7195c None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:24.420698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57374c-1401-4058-9644-7677add7195c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.422097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c57374c-1401-4058-9644-7677add7195c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.430746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 364/744] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:24.431963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508982-e5b4-4855-a507-fbda0630f5c3 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.432253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508982-e5b4-4855-a507-fbda0630f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.432528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0508982-e5b4-4855-a507-fbda0630f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.448926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e0508982-e5b4-4855-a507-fbda0630f5c3 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:24.450195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e0508982-e5b4-4855-a507-fbda0630f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:24.463658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66680c4-6390-4c5b-b422-79309e689f74 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.498756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.499639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.500291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.500578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.508307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.509758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:24.523857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:24.524771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:24.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 381/745] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:24.526183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.531460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 365/746] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:24 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 13:28:24.532834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508982-e5b4-4855-a507-fbda0630f5c3 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.570527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:24.631042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:24.642164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c74822-0c88-42b6-b944-905f066f4696 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.654189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0508982-e5b4-4855-a507-fbda0630f5c3 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.686765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.687575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.687891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.688165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.689190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.690021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.690291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.690570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.696734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.699108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.700721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.702190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:24.715250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:24.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:24.717322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:24.719670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:24.720487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:24.721357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:24.721357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:24.721357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:24.721357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:24.722006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 382/747] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:24.723009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.723984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 366/748] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:24.724868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.817562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:24.828988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f57bf2-17de-413e-8f11-11580ba03710 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.835251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9c9cd-98a2-42c1-bb99-13fbd2577c34 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:24.863436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.864168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.864448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.864719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.865513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:24.865827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.867256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.870517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66a05-9f51-474d-bd77-ff4fa637faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:24.871196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66a05-9f51-474d-bd77-ff4fa637faac None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:24.871515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66a05-9f51-474d-bd77-ff4fa637faac None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:24.871821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e66a05-9f51-474d-bd77-ff4fa637faac None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:24.872544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66a05-9f51-474d-bd77-ff4fa637faac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:24.873936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e66a05-9f51-474d-bd77-ff4fa637faac None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:24.880195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 383/749] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:24.881034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.888427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 367/750] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:28:24 2022] POST /identity/v3/services => generated 240 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:24.889523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66a05-9f51-474d-bd77-ff4fa637faac None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:24.901416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:25.018168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9609a2-871b-45d5-9ed8-1235d524cb7f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.022721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e66a05-9f51-474d-bd77-ff4fa637faac None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.057995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.059058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.059778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.060061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.061294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:25.061611 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.062464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.063279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.063398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.063801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.064168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.065032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:25.065516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.067119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.077316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:25.082733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 368/751] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:25.084519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:25.090507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 384/752] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:28:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:25.090507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:25.176794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:25.212701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33396381-4565-4b7f-85b0-5931e75807e2 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.218846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e5033-2b37-45d2-935a-6daa8584c3b9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.255550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.256780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.257260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.257568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.257998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.258240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.258524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.258797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.259852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=a57f6f39bba04a9d80a885340239cea3) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:25.260168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.262010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.267553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.269369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 369/753] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:25 2022] GET /identity/v3/role_assignments?user.id=a57f6f39bba04a9d80a885340239cea3&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:25.269506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.271751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:25.298486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:25.299573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:25.300609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:25.303536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 385/754] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:28:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:25.310594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:25.405168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:25.449664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a461d6f-f970-4808-80ef-2ed6770092a0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.486701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f33d8-9821-44ac-94ed-bfd11b032b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.487437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f33d8-9821-44ac-94ed-bfd11b032b0f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.487750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f33d8-9821-44ac-94ed-bfd11b032b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.488142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f33d8-9821-44ac-94ed-bfd11b032b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.502109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f33d8-9821-44ac-94ed-bfd11b032b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.503896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f33d8-9821-44ac-94ed-bfd11b032b0f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.509424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0f289-b4a6-4581-a873-8079810e0d54 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-037f33d8-9821-44ac-94ed-bfd11b032b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:25.523208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:25.524205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:25.525102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:25.525102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:25.525102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:25.525102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:25.529232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 370/755] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:25.531315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7219-7f5a-4a5d-afea-ed5cb1433d9d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.531315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7219-7f5a-4a5d-afea-ed5cb1433d9d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.531315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c7219-7f5a-4a5d-afea-ed5cb1433d9d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.532978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 371/756] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:25.533686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c7219-7f5a-4a5d-afea-ed5cb1433d9d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:25.550211 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:25.558749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e8f7c-0d83-40ae-bfca-c6e345ee7a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.560254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e8f7c-0d83-40ae-bfca-c6e345ee7a7e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.560725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e8f7c-0d83-40ae-bfca-c6e345ee7a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.561168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e8f7c-0d83-40ae-bfca-c6e345ee7a7e None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.562196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e8f7c-0d83-40ae-bfca-c6e345ee7a7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:25.562690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e8f7c-0d83-40ae-bfca-c6e345ee7a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.564503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e8f7c-0d83-40ae-bfca-c6e345ee7a7e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.584208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 386/757] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 12 13:28:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:25.586945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78368d-6dc2-4e18-b7e7-c36a6d927fe2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.587669 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78368d-6dc2-4e18-b7e7-c36a6d927fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.588270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78368d-6dc2-4e18-b7e7-c36a6d927fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.606494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4a78368d-6dc2-4e18-b7e7-c36a6d927fe2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:25.608066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4a78368d-6dc2-4e18-b7e7-c36a6d927fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:25.659129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c7219-7f5a-4a5d-afea-ed5cb1433d9d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.678148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:25.687864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 387/758] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:25.689140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78368d-6dc2-4e18-b7e7-c36a6d927fe2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:25.701171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.707617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.707617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.707617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.707617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:25.707617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.707617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.718042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 372/759] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:25.727657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:25.804297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78368d-6dc2-4e18-b7e7-c36a6d927fe2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.821519 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:25.829407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0e41a-53b8-4414-8940-9e84bc0cd004 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:25.842896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f8c01-b544-42b6-8ac0-31673bddab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.843791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f8c01-b544-42b6-8ac0-31673bddab9b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.844067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f8c01-b544-42b6-8ac0-31673bddab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.844340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377f8c01-b544-42b6-8ac0-31673bddab9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.880871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:25.882681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:25.883463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:25.884270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:25.901188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.903210 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:25.921473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:25.922404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:25.923280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:25.923280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:25.923280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:25.923280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:25.923280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:25.923280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:25.923280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:25.923280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:25.925982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 373/760] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:25.927019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:25.933397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f8c01-b544-42b6-8ac0-31673bddab9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:25.935385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377f8c01-b544-42b6-8ac0-31673bddab9b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:25.968068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:26.047530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5890961b-8d38-4c08-bae6-ca548310ffea None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.055527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 388/761] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:28:26.056539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f8c01-b544-42b6-8ac0-31673bddab9b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.081454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:26.087803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.088728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.089078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.089529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.090452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.091921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:26.107121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:26.108334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:26.109346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:26.115355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 374/762] 10.222.0.64 () {56 vars in 1129 bytes} [Tue Jul 12 13:28:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:26.116362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.171909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377f8c01-b544-42b6-8ac0-31673bddab9b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.211928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.213465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.214052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.214547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.215702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:26.216192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.218012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.220921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:26.224213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f98d5-1cb9-4130-99b0-f58ed5c5b464 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.233690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 389/763] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:26.235308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.259357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.260215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.260504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.260782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.273192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.274685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:26.293779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:26.294752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:26.295847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:26.295847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:26.295847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:26.295847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:26.299825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 375/764] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:26.300803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.408752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd67093-3e23-4373-84a6-0079edd75bf8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.443293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9dd2-9715-43b0-af10-c32885721ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.444158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9dd2-9715-43b0-af10-c32885721ea6 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.444443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9dd2-9715-43b0-af10-c32885721ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.444720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521a9dd2-9715-43b0-af10-c32885721ea6 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/6eb064e8062d4a4eb7a7974f7200c86f/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.446727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9dd2-9715-43b0-af10-c32885721ea6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=6eb064e8062d4a4eb7a7974f7200c86f, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.448518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521a9dd2-9715-43b0-af10-c32885721ea6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.450191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:26.465497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 376/765] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:26 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/6eb064e8062d4a4eb7a7974f7200c86f/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:26.466656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9dd2-9715-43b0-af10-c32885721ea6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.477439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf508df-15a1-4972-b132-83eed733823e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.489116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:26.518142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.519332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.519817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.520275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.521255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:26.521745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.523308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.530177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 390/766] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:26.536884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.614532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521a9dd2-9715-43b0-af10-c32885721ea6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.661634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.662715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.663011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.663292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.664321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:26.664635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.666001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f00b0b-8ab0-4c8b-8984-044f26e56572 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.666145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.682674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 377/767] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:26.688657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.704513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.705491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.705929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.706384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.707240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:26.707714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.709222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.714921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 391/768] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:26.723084 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.731337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:26.777443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:26.811439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de265285-8e5f-4a75-805c-a0e3d788fc2c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.846056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469e4d8-ca4a-403c-b194-a42f63ab11aa None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:26.849766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.850577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.850859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.851131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.858719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.860203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:26.876918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:26.878034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:26.879208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 378/769] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:26.884413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.885618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:26.886455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:26.886975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:26.887496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:26.888585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] RBAC: Adding query filter params (interface=public, service_id=9152a4a3f1ca46e5b5cb32d52b8379c3, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:26.889045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:26.890560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:26.900491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 392/770] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/endpoints?service_id=9152a4a3f1ca46e5b5cb32d52b8379c3&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:26.907305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:26.993140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:27.027820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fe9906-2ef7-492c-92b3-b1eeb83f9dae None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:27.045898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfccee-b64f-40cf-b9d2-1600f8d82907 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:27.069031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a59829-2c7b-4d2b-8e65-b26d3f1ed0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:27.070253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59829-2c7b-4d2b-8e65-b26d3f1ed0ef None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.070540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59829-2c7b-4d2b-8e65-b26d3f1ed0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.070819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59829-2c7b-4d2b-8e65-b26d3f1ed0ef None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.071542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a59829-2c7b-4d2b-8e65-b26d3f1ed0ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:27.073482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a59829-2c7b-4d2b-8e65-b26d3f1ed0ef None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:27.081101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:27.087638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 393/771] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:27.097648 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5299a7-3728-40cb-92b8-3fe3b5fe366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:27.098739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5299a7-3728-40cb-92b8-3fe3b5fe366e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.099221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5299a7-3728-40cb-92b8-3fe3b5fe366e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.099735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5299a7-3728-40cb-92b8-3fe3b5fe366e None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.100738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5299a7-3728-40cb-92b8-3fe3b5fe366e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:27.101248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5299a7-3728-40cb-92b8-3fe3b5fe366e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:27.102895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5299a7-3728-40cb-92b8-3fe3b5fe366e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:27.117557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 379/772] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:27.124024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a59829-2c7b-4d2b-8e65-b26d3f1ed0ef None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:27.253136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a59829-2c7b-4d2b-8e65-b26d3f1ed0ef None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:27.286208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:27.289128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e4d21-865e-433b-a227-d9c419361d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:27.289797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e4d21-865e-433b-a227-d9c419361d4f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.291069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e4d21-865e-433b-a227-d9c419361d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.291069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e4d21-865e-433b-a227-d9c419361d4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.291262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e4d21-865e-433b-a227-d9c419361d4f None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=7a35fb3434e64a259e8b9938ef38b32f) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:27.291469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e4d21-865e-433b-a227-d9c419361d4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:27.292942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e4d21-865e-433b-a227-d9c419361d4f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:27.299332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 394/773] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:27 2022] GET /identity/v3/role_assignments?user.id=7a35fb3434e64a259e8b9938ef38b32f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:27.437637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d3fa1-2d3a-43eb-b186-87b2b16ff731 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.438180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d3fa1-2d3a-43eb-b186-87b2b16ff731 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.438180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43d3fa1-2d3a-43eb-b186-87b2b16ff731 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.439934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 380/774] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:27.445323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387f9c2-b721-4d4e-b178-265503d3401b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.445605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387f9c2-b721-4d4e-b178-265503d3401b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.445887 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387f9c2-b721-4d4e-b178-265503d3401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.468382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9387f9c2-b721-4d4e-b178-265503d3401b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:27.469584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9387f9c2-b721-4d4e-b178-265503d3401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:27.503866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de712be-4f82-485e-8d5a-1dc676c539e1 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.504147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de712be-4f82-485e-8d5a-1dc676c539e1 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.504350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de712be-4f82-485e-8d5a-1dc676c539e1 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.505935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 381/775] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:27.511073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248f9f-4f90-4680-9f8c-2aea9f8d5c26 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.511355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248f9f-4f90-4680-9f8c-2aea9f8d5c26 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.511658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47248f9f-4f90-4680-9f8c-2aea9f8d5c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.528389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-47248f9f-4f90-4680-9f8c-2aea9f8d5c26 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:27.529679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-47248f9f-4f90-4680-9f8c-2aea9f8d5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:27.561555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 395/776] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:27.602404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387f9c2-b721-4d4e-b178-265503d3401b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:27.620926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 382/777] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:27.645156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47248f9f-4f90-4680-9f8c-2aea9f8d5c26 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:27.766699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47248f9f-4f90-4680-9f8c-2aea9f8d5c26 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:27.793291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:27.802268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387f9c2-b721-4d4e-b178-265503d3401b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:27.817548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296475-a949-45e0-a149-923c33e940d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:27.818728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296475-a949-45e0-a149-923c33e940d2 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.819226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296475-a949-45e0-a149-923c33e940d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.819719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7296475-a949-45e0-a149-923c33e940d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.840252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7296475-a949-45e0-a149-923c33e940d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:27.847796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f7296475-a949-45e0-a149-923c33e940d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:27.849607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:27.850540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:27.851372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:27.854175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 383/778] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:27.860443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296475-a949-45e0-a149-923c33e940d2 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:27.873195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:27.874352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:27.874824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:27.875305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:27.876261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:27.879463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:27.899457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:27.900557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:27.901480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:27.908480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 396/779] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:27 2022] GET /identity/v3/services/network => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:27.915323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:28.026389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf89b3-c668-41ea-87eb-db99d6d0e3c7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:28.064364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:28.065420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:28.065925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:28.066388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:28.067294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:28.067933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:28.069510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:28.075146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 397/780] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:28.080949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:28.114166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7296475-a949-45e0-a149-923c33e940d2 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:28.141721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:28.189300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:28.189988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:28.190266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:28.190562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:28.191313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:28.191634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:28.192306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc72bd-588c-4ba6-9d27-c3f4ce0efed7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:28.193016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:28.215637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 384/781] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:28.229470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:28.232757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:28.233901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:28.234377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:28.234840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:28.235783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] RBAC: Adding query filter params (type=network) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:28.236310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:28.237916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:28.243589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 398/782] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:28.250067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:28.325762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:28.360111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86fbca-1218-4516-9160-2c713109ba99 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:28.395635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:28.405883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:28.406952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:28.407461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:28.407946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:28.408952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] RBAC: Adding query filter params (interface=public, service_id=f58483d8de6f4ea99d74a59f9dc51a42, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:28.409491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:28.411163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:28.417258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 399/783] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 12 13:28:28 2022] GET /identity/v3/endpoints?service_id=f58483d8de6f4ea99d74a59f9dc51a42&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:28.423176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:28.424775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12a8c8-cb79-4923-8e63-f2e2a9fc115c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:28.480331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:28.481126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:28.481405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:28.481681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:28.499750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:28.501458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:28.526332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6abaa-e401-4451-b004-4db80f84d191 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:28.532524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:28.533430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:28.534314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:28.534314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:28.534314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:28.534314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:28.534314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 385/784] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:28.544198 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:28.597454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992f81-9f7d-4a7b-80a2-6f31167605de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:28.598552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992f81-9f7d-4a7b-80a2-6f31167605de None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:28.599028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992f81-9f7d-4a7b-80a2-6f31167605de None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:28.599563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc992f81-9f7d-4a7b-80a2-6f31167605de None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:28.600505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc992f81-9f7d-4a7b-80a2-6f31167605de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:28.602069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc992f81-9f7d-4a7b-80a2-6f31167605de None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:28.608425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 400/785] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:28:28 2022] GET /identity/v3/services => generated 772 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:28.682313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:28.689383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323ce0ec-ace1-4913-96cc-e1dd4db01593 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:28.727375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:28.728091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:28.728653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:28.728929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:28.729667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:28.729974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:28.731467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:28.744947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 386/786] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:28.750596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992f81-9f7d-4a7b-80a2-6f31167605de None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:28.830017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:28.889152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc992f81-9f7d-4a7b-80a2-6f31167605de None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:28.934957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:28.936431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:28.936908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:28.937410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:28.953009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:28.954469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:28.969512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:28.970470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:28.971424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 401/787] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:28.976758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:29.096339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d0c1e-f249-4612-8c79-2d1d67e1c0c5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:29.137895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65379d84-5a8f-4540-8fca-a3feeb5cdfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:29.138584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379d84-5a8f-4540-8fca-a3feeb5cdfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.138866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379d84-5a8f-4540-8fca-a3feeb5cdfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.139141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65379d84-5a8f-4540-8fca-a3feeb5cdfb1 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.140075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65379d84-5a8f-4540-8fca-a3feeb5cdfb1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:29.140334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65379d84-5a8f-4540-8fca-a3feeb5cdfb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:29.141781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65379d84-5a8f-4540-8fca-a3feeb5cdfb1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:29.169940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 387/788] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 12 13:28:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:29.175535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:29.278290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f3bf-ce6f-43dd-90f9-347b8213454f None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.278941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f3bf-ce6f-43dd-90f9-347b8213454f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.279407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a4f3bf-ce6f-43dd-90f9-347b8213454f None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.281249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 388/789] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:29.287184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf525b-2835-41e9-b3a3-cb1a79f1a8a9 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.287550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf525b-2835-41e9-b3a3-cb1a79f1a8a9 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.287862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf525b-2835-41e9-b3a3-cb1a79f1a8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.324468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81123e91-b8be-4deb-a561-2f649036ecd0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:29.326883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-acdf525b-2835-41e9-b3a3-cb1a79f1a8a9 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:29.328128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-acdf525b-2835-41e9-b3a3-cb1a79f1a8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:29.349379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:29.351942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:29.389733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:29.390598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.390827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.391101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.416788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:29.418635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:29.439314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 389/790] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:29.451640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:29.452531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:29.453436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:29.453436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:29.453436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:29.453436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:29.455704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 402/791] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:29.460915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf525b-2835-41e9-b3a3-cb1a79f1a8a9 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:29.474119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:29.575778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf525b-2835-41e9-b3a3-cb1a79f1a8a9 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:29.614380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:29.615052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.615333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.615622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.616783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:29.617098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:29.618691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:29.631385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 390/792] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:29.637716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:29.642462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:29.712541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db376d35-0490-4d5d-987e-b614b22d353c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:29.751224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005fe20-b273-4eaf-8a6d-c32a5edbb421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:29.752063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fe20-b273-4eaf-8a6d-c32a5edbb421 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.752349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fe20-b273-4eaf-8a6d-c32a5edbb421 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.752625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005fe20-b273-4eaf-8a6d-c32a5edbb421 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.762989 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005fe20-b273-4eaf-8a6d-c32a5edbb421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-f005fe20-b273-4eaf-8a6d-c32a5edbb421 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:29.770685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:29.771641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:29.772493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 403/793] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:29.774062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30e81-42e3-4fac-9cbd-e99552650517 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.774062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30e81-42e3-4fac-9cbd-e99552650517 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.774062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a30e81-42e3-4fac-9cbd-e99552650517 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.775505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 404/794] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:29.776758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212ecf-2f61-486b-835c-eb538406bda6 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.777047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212ecf-2f61-486b-835c-eb538406bda6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.777319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212ecf-2f61-486b-835c-eb538406bda6 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.778676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 405/795] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:29.780751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212ecf-2f61-486b-835c-eb538406bda6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:29.789991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e950ab6-e5b4-47ae-a5f9-4a6678dc6c86 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:29.806007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:29.827160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9fc879-89e5-4b1f-b0c2-25792063869a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:29.828063 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc879-89e5-4b1f-b0c2-25792063869a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.828347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc879-89e5-4b1f-b0c2-25792063869a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.828621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9fc879-89e5-4b1f-b0c2-25792063869a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.835974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fc879-89e5-4b1f-b0c2-25792063869a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:29.837422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9fc879-89e5-4b1f-b0c2-25792063869a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-1d9fc879-89e5-4b1f-b0c2-25792063869a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:29.851475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:29.852559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:29.853462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 391/796] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:29.854273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70572b-a08d-4631-a857-10d486cb8bbb None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.854560 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70572b-a08d-4631-a857-10d486cb8bbb None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.854837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70572b-a08d-4631-a857-10d486cb8bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.871208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1f70572b-a08d-4631-a857-10d486cb8bbb None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:29.872434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1f70572b-a08d-4631-a857-10d486cb8bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:29.902433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7212ecf-2f61-486b-835c-eb538406bda6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:29.931056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:29.938028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:29.938713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.938991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.939270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.940052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:29.940356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:29.943717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 392/797] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:29.943849 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:29.943928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e18af-25dd-4f1c-ac43-8352ffe3b712 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:29.943928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e18af-25dd-4f1c-ac43-8352ffe3b712 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:29.943928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149e18af-25dd-4f1c-ac43-8352ffe3b712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:29.959205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 406/798] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:29.961171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:29.970038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-149e18af-25dd-4f1c-ac43-8352ffe3b712 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:29.971271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-149e18af-25dd-4f1c-ac43-8352ffe3b712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:30.051664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 393/799] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:30.051664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e18af-25dd-4f1c-ac43-8352ffe3b712 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.055097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:30.077133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f4d127-3849-415b-a047-a438f77274c2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.114017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.114707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.114988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.115259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.116166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:30.116482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:30.117918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:30.135872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 407/800] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:30.135872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.166872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149e18af-25dd-4f1c-ac43-8352ffe3b712 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.193118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:30.205580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.206398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.206691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.206960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.218452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:30.220046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:30.233389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c35ce0-5aec-484f-9865-5ac728f9ca1f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:30.238597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:30.239466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:30.240411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:30.240411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:30.240411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:30.240411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:30.240411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 394/801] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:30.241157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.271740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.272701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.272987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.273279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.273969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:30.275362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:30.287657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:30.288587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:30.289437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 408/802] 10.222.0.64 () {56 vars in 1129 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:30.290335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.297927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:30.357677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22051f4-5622-48ef-8637-982573f26bc2 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.393217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274fc3-3e33-4c52-bc13-1dc738613ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.394024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274fc3-3e33-4c52-bc13-1dc738613ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.394302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274fc3-3e33-4c52-bc13-1dc738613ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.394573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36274fc3-3e33-4c52-bc13-1dc738613ad1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.404809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36274fc3-3e33-4c52-bc13-1dc738613ad1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:30.408140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02245-2868-4256-9c5b-cc2a3481fdbc None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-36274fc3-3e33-4c52-bc13-1dc738613ad1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:30.412442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:30.413354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:30.414205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 395/803] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:30.414891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274fc3-3e33-4c52-bc13-1dc738613ad1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.450937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a230e2f-a58b-4918-93c7-472581d2de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.451788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a230e2f-a58b-4918-93c7-472581d2de76 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.452084 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a230e2f-a58b-4918-93c7-472581d2de76 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.452338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a230e2f-a58b-4918-93c7-472581d2de76 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/a57f6f39bba04a9d80a885340239cea3/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.453813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:30.454801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a230e2f-a58b-4918-93c7-472581d2de76 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=a57f6f39bba04a9d80a885340239cea3, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:30.456229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a230e2f-a58b-4918-93c7-472581d2de76 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:30.475632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 409/804] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:30 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/a57f6f39bba04a9d80a885340239cea3/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:30.475632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a230e2f-a58b-4918-93c7-472581d2de76 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.535996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:30.557049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36274fc3-3e33-4c52-bc13-1dc738613ad1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.590214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a230e2f-a58b-4918-93c7-472581d2de76 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.612877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.614588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.615320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.615825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.617547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:30.618106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:30.620819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:30.627890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.628591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.628871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.629148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.629926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:30.630236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:30.631952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:30.637726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 410/805] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:30.638641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.639028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 396/806] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:30.645358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.760025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:30.766755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e57d3-b9fa-4f85-88c8-cd06825e2866 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.774024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb8ceb-111d-403c-997d-30cb36076ed9 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.803426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.804659 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.805163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.805268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:30.805745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.815195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:30.815926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:30.816851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:30.817025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:30.817658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:30.818119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:30.819326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:30.820401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:30.821932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:30.835264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:30.836277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 397/808] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:30.837214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.838373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 411/808] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:30.840076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:30.964023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa54df2-d2b0-4249-b929-ae4ff46da75d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:30.976823 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee718f5-76d2-4337-9ad9-adf9054b3a55 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.014649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.015541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.015921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.016602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.017818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:31.018137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.019891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.022892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c8b83a-8ff8-411c-8761-6935d203e5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.023867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8b83a-8ff8-411c-8761-6935d203e5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.024360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8b83a-8ff8-411c-8761-6935d203e5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.024725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c8b83a-8ff8-411c-8761-6935d203e5a7 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.025668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8b83a-8ff8-411c-8761-6935d203e5a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:31.025986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8b83a-8ff8-411c-8761-6935d203e5a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.026785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 398/809] 10.222.0.64 () {56 vars in 1124 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:31.030291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c8b83a-8ff8-411c-8761-6935d203e5a7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.030421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.048077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 412/810] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:28:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:31.049975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38202fba-7723-42c6-b706-48999d6bf7d0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.050418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38202fba-7723-42c6-b706-48999d6bf7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.051103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38202fba-7723-42c6-b706-48999d6bf7d0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.053732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:31.056263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 413/811] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:31.056907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38202fba-7723-42c6-b706-48999d6bf7d0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.111439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:31.137201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b787e0d-cdab-4dd9-97c2-acee388f2bc0 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.167739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38202fba-7723-42c6-b706-48999d6bf7d0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.170375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.171241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.171552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.171856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.183878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.185796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:31.204943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:31.205893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:31.206862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:31.206862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:31.206862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:31.206862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:31.207904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 399/812] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:31.208631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.210493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f62d0-9dba-40f1-a498-dcb4199c9daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.211167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f62d0-9dba-40f1-a498-dcb4199c9daa None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.211445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f62d0-9dba-40f1-a498-dcb4199c9daa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.211763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f62d0-9dba-40f1-a498-dcb4199c9daa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.212550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f62d0-9dba-40f1-a498-dcb4199c9daa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.213937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f62d0-9dba-40f1-a498-dcb4199c9daa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.236958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 414/813] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:28:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:31.249230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4278b-9319-4f90-a908-3f53ad3ec634 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.249636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4278b-9319-4f90-a908-3f53ad3ec634 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.249805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a4278b-9319-4f90-a908-3f53ad3ec634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.281649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-52a4278b-9319-4f90-a908-3f53ad3ec634 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:31.284242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-52a4278b-9319-4f90-a908-3f53ad3ec634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:31.297753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:31.336096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2782f41d-95e3-427d-b084-c98dfa596551 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.393406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f408b8a-e4d9-4274-a749-561689d3121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.394435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408b8a-e4d9-4274-a749-561689d3121f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.394543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 415/814] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:31.395022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408b8a-e4d9-4274-a749-561689d3121f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.395477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f408b8a-e4d9-4274-a749-561689d3121f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.395589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4278b-9319-4f90-a908-3f53ad3ec634 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.441916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:31.479131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f408b8a-e4d9-4274-a749-561689d3121f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.481069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f408b8a-e4d9-4274-a749-561689d3121f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.530888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a4278b-9319-4f90-a908-3f53ad3ec634 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.565809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:31.574710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.575725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.576156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.576628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.577511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:31.577963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.579503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.592174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 416/815] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:31.597519 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.602283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 400/816] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:28:31.603194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f408b8a-e4d9-4274-a749-561689d3121f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.702825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:31.706230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f408b8a-e4d9-4274-a749-561689d3121f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.714208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeee2b9-71ac-4836-8d57-e4ae20143580 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.741111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.741935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.742216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.742490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.750111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.750526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.751544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.751677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.752273 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.752739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] PATH_INFO: `/v3/services/network` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.753545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.755094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:31.766868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:31.768077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:31.769291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:31.770793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:31.771761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 13:28:31.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:31.773443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 401/817] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:31.773443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.775388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 417/818] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:31.776338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.807626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:31.895046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74d3f-b12f-4314-8412-9964f309aff4 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.907390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243aed3-ff1a-4b1c-aa6a-804ce5fe7b30 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:31.932702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.933919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.934732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.935218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.940974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:31.942045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:31.942491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:31.942936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:31.944133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:31.944442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.945875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.947885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:31.949697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:31.967556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 418/819] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:31.968413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:31.969304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:31.970258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:31.970258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:31.970258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:31.970258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:31.970485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.977129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 402/820] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:31.978259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:31.983745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:32.067397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:32.071655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc895-21d4-4e51-941d-6bf16fe817aa None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.090234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b7542-269a-42d8-8dff-c65b5f0f4590 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.106213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.106643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.106919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.107187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.107942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] RBAC: Adding query filter params (name=network) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:32.108233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.109596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.118771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 419/821] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:32.119546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.129763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.130929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.131512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.132015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.143800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.145753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:32.165141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:32.166055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:32.166957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:32.166957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:32.166957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:32.166957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:32.169616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 403/822] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:32.170713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.202140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:32.225455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a47db6-53b6-449d-9f0b-3b257baccf67 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.260305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.261028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.261310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.261579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.262362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:32.262673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.264156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.279632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 420/823] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:32.279632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.292078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017cb43d-9722-4a4b-9ef2-c5da1babed5d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.386992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afda63-5b14-4a26-8126-95943fcacf6c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.423591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.424234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.424512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.424781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.425513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:32.425817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.427189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.429748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:32.445724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 421/824] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:32.446624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.459064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:32.462177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.463174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.463556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.464053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.464971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] RBAC: Adding query filter params (type=network) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:32.465383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.466887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.473219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 404/825] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:32.474208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.553995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f9334-7f1e-4118-814d-a6f7a331e1e7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.576562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a92aeb-599e-4752-9e97-874cb21aa900 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.589525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.590588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.590869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.591143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.598469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.599969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.611985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb70a7e-9e93-438f-b871-be7ca0f8e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.612905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70a7e-9e93-438f-b871-be7ca0f8e48f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.613283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70a7e-9e93-438f-b871-be7ca0f8e48f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.613655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb70a7e-9e93-438f-b871-be7ca0f8e48f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:32.614492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:32.615448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:32.616377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 422/826] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:32.616873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.626188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb70a7e-9e93-438f-b871-be7ca0f8e48f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.627716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb70a7e-9e93-438f-b871-be7ca0f8e48f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-7bb70a7e-9e93-438f-b871-be7ca0f8e48f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:32.641749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:32.642903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:32.644129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:32.644129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:32.644129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:32.644129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:32.644129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:32.644129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:32.644129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:32.644129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:32.648054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 405/827] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:32.649395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a14fb-2671-4c28-98d6-7558ae8826da None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.649681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a14fb-2671-4c28-98d6-7558ae8826da None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.649958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a14fb-2671-4c28-98d6-7558ae8826da None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.651514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 406/828] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:32.652235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a14fb-2671-4c28-98d6-7558ae8826da None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.685157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:32.719820 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:32.730193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eda70-226b-4dfe-a78e-f62ace968104 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.766781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720a6ca-a5bf-474c-a589-08f607a746bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.767234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a14fb-2671-4c28-98d6-7558ae8826da None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.768094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a6ca-a5bf-474c-a589-08f607a746bd None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.768650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a6ca-a5bf-474c-a589-08f607a746bd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.769016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720a6ca-a5bf-474c-a589-08f607a746bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.770221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720a6ca-a5bf-474c-a589-08f607a746bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.771222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720a6ca-a5bf-474c-a589-08f607a746bd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.792685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 423/829] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:28:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:32.793706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720a6ca-a5bf-474c-a589-08f607a746bd None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.813986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1d078-0f9d-426a-83fe-bfcd277eafa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.815351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d078-0f9d-426a-83fe-bfcd277eafa0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.816338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d078-0f9d-426a-83fe-bfcd277eafa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.816804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1d078-0f9d-426a-83fe-bfcd277eafa0 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.818065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d078-0f9d-426a-83fe-bfcd277eafa0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:32.818536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d078-0f9d-426a-83fe-bfcd277eafa0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.820937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1d078-0f9d-426a-83fe-bfcd277eafa0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.844027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 407/830] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:32.847023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b02e3-f8de-40cf-ae3f-d8e21e3f70e4 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.847526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b02e3-f8de-40cf-ae3f-d8e21e3f70e4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.847978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b02e3-f8de-40cf-ae3f-d8e21e3f70e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.869545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e75b02e3-f8de-40cf-ae3f-d8e21e3f70e4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:32.870944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e75b02e3-f8de-40cf-ae3f-d8e21e3f70e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:32.924181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720a6ca-a5bf-474c-a589-08f607a746bd None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:32.940028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:32.952018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 408/831] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:32.953107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b02e3-f8de-40cf-ae3f-d8e21e3f70e4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:32.965797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:32.966722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:32.967148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:32.967562 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:32.968526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:32.968978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:32.970751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:32.990337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 424/832] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:32.990337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.032142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:33.100370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b02e3-f8de-40cf-ae3f-d8e21e3f70e4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:33.112689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beec425-bfae-4635-8708-58e6a9791250 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:33.138981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:33.139679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.139972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.140240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.141075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=6eb064e8062d4a4eb7a7974f7200c86f) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:33.141394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:33.142842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:33.148845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 409/833] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/role_assignments?user.id=6eb064e8062d4a4eb7a7974f7200c86f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:33.149589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.163152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65a88a-98ff-42de-b4bb-2fd7a5d5e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:33.164571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a88a-98ff-42de-b4bb-2fd7a5d5e503 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.164855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a88a-98ff-42de-b4bb-2fd7a5d5e503 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.165129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65a88a-98ff-42de-b4bb-2fd7a5d5e503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.183202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65a88a-98ff-42de-b4bb-2fd7a5d5e503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-aa65a88a-98ff-42de-b4bb-2fd7a5d5e503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:33.195651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:33.196624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:28:33.197526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:33.201010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 425/834] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:33.206906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65a88a-98ff-42de-b4bb-2fd7a5d5e503 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.261640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:33.310491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eda850-e9f9-4054-9d01-54a54e604a56 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:33.320925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:33.345480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65a88a-98ff-42de-b4bb-2fd7a5d5e503 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:33.357486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd3ea9-139d-4f00-87c5-d7b89b03fcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:33.358991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3ea9-139d-4f00-87c5-d7b89b03fcf8 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.360270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3ea9-139d-4f00-87c5-d7b89b03fcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.360270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3ea9-139d-4f00-87c5-d7b89b03fcf8 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/7a35fb3434e64a259e8b9938ef38b32f/roles/eb1899ecc6e0420f90de62e74998ca33` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.377787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd3ea9-139d-4f00-87c5-d7b89b03fcf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=7a35fb3434e64a259e8b9938ef38b32f, role_id=eb1899ecc6e0420f90de62e74998ca33)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:33.379232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd3ea9-139d-4f00-87c5-d7b89b03fcf8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:33.396749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f9e293-1450-4c01-bd27-f4a38e0a5e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:33.397220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 410/835] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:33 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/7a35fb3434e64a259e8b9938ef38b32f/roles/eb1899ecc6e0420f90de62e74998ca33 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:28:33.397442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e293-1450-4c01-bd27-f4a38e0a5e79 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.397727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e293-1450-4c01-bd27-f4a38e0a5e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.398002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f9e293-1450-4c01-bd27-f4a38e0a5e79 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.404499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9e293-1450-4c01-bd27-f4a38e0a5e79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:33.404844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9e293-1450-4c01-bd27-f4a38e0a5e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:33.406232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f9e293-1450-4c01-bd27-f4a38e0a5e79 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:33.421169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 426/836] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:33.426751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd3ea9-139d-4f00-87c5-d7b89b03fcf8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.469585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c5e7-aff8-4943-a7ca-12ed5e3eda67 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.470218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c5e7-aff8-4943-a7ca-12ed5e3eda67 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.470218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1c5e7-aff8-4943-a7ca-12ed5e3eda67 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.471770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 427/837] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:33.477703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4653f3-19b0-4dbe-874a-2e859ea4a015 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.478343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4653f3-19b0-4dbe-874a-2e859ea4a015 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.478835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4653f3-19b0-4dbe-874a-2e859ea4a015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.498274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-dd4653f3-19b0-4dbe-874a-2e859ea4a015 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:33.499923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dd4653f3-19b0-4dbe-874a-2e859ea4a015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:33.550267 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd3ea9-139d-4f00-87c5-d7b89b03fcf8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:33.596065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 428/838] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:33.597828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:33.598646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.598925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.599196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.610138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:33.611648 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:33.621899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4653f3-19b0-4dbe-874a-2e859ea4a015 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:33.630442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:33.632290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:33.633918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:33.633918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:33.633918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:33.633918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:33.633918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 411/839] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:33.638196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.656528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:33.658401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:33.744104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4653f3-19b0-4dbe-874a-2e859ea4a015 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:33.780811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:33.781801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.782154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.782739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.783342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:33.784860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:33.789865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6e52f-1943-4248-a811-112ccf8087cc None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:33.798194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:33.799224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:33.800098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 429/840] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:33.805985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.836066 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:33.837828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.838300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.838773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.840257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:33.840948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:33.842570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:33.858231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 412/841] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:33.864856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.907858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:33.923206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8a98fb-2e59-4842-bb9b-8db9d852ee0b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:33.937965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:33.966145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:33.966838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:33.967118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:33.967392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:33.968327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:33.968641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:33.970680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:33.977080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 430/842] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:33.983255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:33.987081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18ec8e-f56a-40f5-a17d-7f8d84c9af72 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:34.029959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86275b-a491-4609-9758-752a5425567b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:34.031123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86275b-a491-4609-9758-752a5425567b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:34.031677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86275b-a491-4609-9758-752a5425567b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:34.032148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86275b-a491-4609-9758-752a5425567b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:34.040675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86275b-a491-4609-9758-752a5425567b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:34.042441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86275b-a491-4609-9758-752a5425567b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-8f86275b-a491-4609-9758-752a5425567b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:34.056976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:34.057988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 13:28:34.059023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:34.062025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 413/843] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:28:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:34.069875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86275b-a491-4609-9758-752a5425567b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:34.099684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2522470-cbfa-4af1-9287-16c30168dec1 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:34.142433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:34.143117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:34.143399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:34.143703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:34.144429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:34.144891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:34.146619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:34.159641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 431/844] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:34.200927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86275b-a491-4609-9758-752a5425567b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:34.236110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:34.240501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:34.241798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:34.242350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:34.243002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:34.243921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:34.244249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:34.245736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:34.267555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 414/845] 10.222.0.64 () {56 vars in 1135 bytes} [Tue Jul 12 13:28:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:34.276749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:34.298433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:34.389503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08b64e-cf20-4a83-974f-66d52a1aaf06 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:34.430944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966f9a-3de1-4d03-b3bd-4eb1cd734404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:34.431630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966f9a-3de1-4d03-b3bd-4eb1cd734404 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:34.431919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966f9a-3de1-4d03-b3bd-4eb1cd734404 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:34.432191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5966f9a-3de1-4d03-b3bd-4eb1cd734404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:34.499843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966f9a-3de1-4d03-b3bd-4eb1cd734404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:34.501294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5966f9a-3de1-4d03-b3bd-4eb1cd734404 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:34.527958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:34.598872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 432/846] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:28:34.604519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:34.712232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8b6e1-ad62-432b-a778-dee5645261cc None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:34.746727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:34.747538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:34.747843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:34.748115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:34.760145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:34.762146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:34.780519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:34.781408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:34.782319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:34.782319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:34.782319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:34.782319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:34.782319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 415/847] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:34.788760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966f9a-3de1-4d03-b3bd-4eb1cd734404 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:34.892703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5966f9a-3de1-4d03-b3bd-4eb1cd734404 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:34.908672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:34.926789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:34.927461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:34.927767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:34.928040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:34.928769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:34.929072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:34.930428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:34.943210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 433/848] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:34.948750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:34.990338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:35.056858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902457b0-ec40-4f53-85e8-e772e7df24ba None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:35.094273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:35.095078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.095358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.095649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.103427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:35.105653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:35.122271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:35.123190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:35.124133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:35.124133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:35.124133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:35.124133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:35.124133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:35.124133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:35.124133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:35.124133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:35.124569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 416/849] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:35.130904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:35.234094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5ddc1-8e89-4846-93b1-90f02a59b764 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:35.268492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f013d31-c9b6-4aa2-a75e-1bdb21a3e2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:35.269161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013d31-c9b6-4aa2-a75e-1bdb21a3e2be None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.269438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013d31-c9b6-4aa2-a75e-1bdb21a3e2be None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.269711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f013d31-c9b6-4aa2-a75e-1bdb21a3e2be None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.270504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013d31-c9b6-4aa2-a75e-1bdb21a3e2be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:35.270813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013d31-c9b6-4aa2-a75e-1bdb21a3e2be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:35.272267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f013d31-c9b6-4aa2-a75e-1bdb21a3e2be None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:35.284473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 434/850] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:35.290486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:35.397864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:35.405118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77fa69-ff68-4aae-ae1b-96f2307dcc3e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:35.408444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906a11-4eeb-44f2-b02b-283f01a71423 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.408731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906a11-4eeb-44f2-b02b-283f01a71423 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.409005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906a11-4eeb-44f2-b02b-283f01a71423 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.411698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 435/851] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:35.416032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aed8e-37c8-425a-a12b-8b807c22398c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.416345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aed8e-37c8-425a-a12b-8b807c22398c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.416602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530aed8e-37c8-425a-a12b-8b807c22398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.433738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-530aed8e-37c8-425a-a12b-8b807c22398c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:35.435240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-530aed8e-37c8-425a-a12b-8b807c22398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:35.440197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:35.441048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.441343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.441621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.442472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=a57f6f39bba04a9d80a885340239cea3) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:35.442786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:35.444270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:35.450794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 417/852] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:35 2022] GET /identity/v3/role_assignments?user.id=a57f6f39bba04a9d80a885340239cea3&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:35.473089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:35.519863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 436/853] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:35.536731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:35.568524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768239c-2031-425e-9058-39d9e6acdbd4 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.568809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768239c-2031-425e-9058-39d9e6acdbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.569083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b768239c-2031-425e-9058-39d9e6acdbd4 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.570756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 437/854] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:35.577882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6745d-45b7-4794-b330-ebd5cb01c69b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.578518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6745d-45b7-4794-b330-ebd5cb01c69b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.579017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6745d-45b7-4794-b330-ebd5cb01c69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.596614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-31d6745d-45b7-4794-b330-ebd5cb01c69b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:35.598183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-31d6745d-45b7-4794-b330-ebd5cb01c69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:35.661438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e0812-5073-43b6-b48c-2ae694449139 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:35.694448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 438/855] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:35.701552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:35.702382 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.703755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.703755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.703755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:35.706265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:35.719155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:35.720241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:35.721287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:35.722973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6745d-45b7-4794-b330-ebd5cb01c69b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:35.727708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 418/856] 10.222.0.64 () {56 vars in 1132 bytes} [Tue Jul 12 13:28:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:35.729954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:35.759286 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:35.827397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:35.835093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6745d-45b7-4794-b330-ebd5cb01c69b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:35.863105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1922-959b-40d5-ab98-2124e10e6a65 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:35.871272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff0a37-48cb-45fe-8891-22d63645879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:35.872428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0a37-48cb-45fe-8891-22d63645879c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.872885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0a37-48cb-45fe-8891-22d63645879c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.873328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff0a37-48cb-45fe-8891-22d63645879c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.884283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff0a37-48cb-45fe-8891-22d63645879c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a4ff0a37-48cb-45fe-8891-22d63645879c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:35.892396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:35.893329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:28:35.894166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:35.897062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 439/857] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:28:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:35.902759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff0a37-48cb-45fe-8891-22d63645879c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:35.913356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:35.914049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:35.914333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:35.914608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:35.915329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:35.915660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:35.917903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:35.929011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 419/858] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:35.931899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:36.012456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff0a37-48cb-45fe-8891-22d63645879c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:36.036017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:36.046236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c4647-b6a4-4e50-82be-032138cf177d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:36.051637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:36.052559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.053028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.053578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.054515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:36.055026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:36.056746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:36.066554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 440/859] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:28:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:36.071659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:36.086107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:36.086721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.087004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.087281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.088020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:36.088331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:36.089728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:36.100060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 420/860] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:36.100690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:36.185750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef4f175-39b8-4588-a200-ef8161c160e4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:36.222546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe5c00-4825-42a7-8bb6-13887984563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:36.223743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5c00-4825-42a7-8bb6-13887984563d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.224166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5c00-4825-42a7-8bb6-13887984563d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.224576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe5c00-4825-42a7-8bb6-13887984563d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.237510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe5c00-4825-42a7-8bb6-13887984563d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:36.239212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe5c00-4825-42a7-8bb6-13887984563d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-cbbe5c00-4825-42a7-8bb6-13887984563d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:36.258131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:36.259295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:36.260456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:36.260456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:36.260456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:36.260456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:36.262463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 441/861] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:36.268353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:36.321886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef1dd-5c8e-43c5-8536-4909f9118cb9 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.322252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef1dd-5c8e-43c5-8536-4909f9118cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.322454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef1dd-5c8e-43c5-8536-4909f9118cb9 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.324113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 442/862] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:36.329018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df503-bd2f-4dfc-b0d1-020af5f04537 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.329303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df503-bd2f-4dfc-b0d1-020af5f04537 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.329585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683df503-bd2f-4dfc-b0d1-020af5f04537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.350034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-683df503-bd2f-4dfc-b0d1-020af5f04537 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:36.351703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-683df503-bd2f-4dfc-b0d1-020af5f04537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:36.373913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9cd368-362a-46e3-9f1a-e2b3d6401902 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:36.411797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:36.412624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.412903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.413170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.413894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:36.414194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:36.415559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:36.428694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 421/863] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:36.433662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:36.434249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:36.438844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 443/864] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:36.468025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df503-bd2f-4dfc-b0d1-020af5f04537 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:36.469127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:36.554464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4608b-bd9d-4847-a44e-7c623e691b50 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:36.577505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683df503-bd2f-4dfc-b0d1-020af5f04537 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:36.600365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:36.601944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.602659 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.603075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.616260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:36.617731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:36.619035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a0ac-bb78-404e-b0b5-65ef8bbbe9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:36.619758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a0ac-bb78-404e-b0b5-65ef8bbbe9c0 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.620043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a0ac-bb78-404e-b0b5-65ef8bbbe9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.620322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a0ac-bb78-404e-b0b5-65ef8bbbe9c0 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.621110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a0ac-bb78-404e-b0b5-65ef8bbbe9c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:36.622481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a0ac-bb78-404e-b0b5-65ef8bbbe9c0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:36.634589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:36.635842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:36.637437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 422/865] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:28:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:36.641531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:36.649722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 444/866] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:28:36 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:28:36.744010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:36.772341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc71df7-2a78-450e-85aa-b15f99e6c7a1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:36.819512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc870501-4647-43d9-894f-427592648022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:36.820222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc870501-4647-43d9-894f-427592648022 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.820500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc870501-4647-43d9-894f-427592648022 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.820768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc870501-4647-43d9-894f-427592648022 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:36.821605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc870501-4647-43d9-894f-427592648022 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:36.821909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc870501-4647-43d9-894f-427592648022 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:36.823333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc870501-4647-43d9-894f-427592648022 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:36.841726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 423/867] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 12 13:28:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:36.847402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a0ac-bb78-404e-b0b5-65ef8bbbe9c0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:36.914780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:36.958249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a0ac-bb78-404e-b0b5-65ef8bbbe9c0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:36.991747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f02fc-b756-4585-a139-380f6166ec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:36.992423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f02fc-b756-4585-a139-380f6166ec8c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:36.992704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f02fc-b756-4585-a139-380f6166ec8c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:36.992977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12f02fc-b756-4585-a139-380f6166ec8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:37.064386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f02fc-b756-4585-a139-380f6166ec8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:37.066233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12f02fc-b756-4585-a139-380f6166ec8c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:37.124332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:37.170793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 445/868] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:36 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 13:28:37.176878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc870501-4647-43d9-894f-427592648022 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:37.285824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc870501-4647-43d9-894f-427592648022 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:37.318088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:37.327895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:37.329030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:37.329509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:37.329977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:37.340765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:37.342469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:37.361641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:37.362573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:37.363479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:37.363479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:37.363479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:37.363479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:37.365760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 424/869] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:37.371680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f02fc-b756-4585-a139-380f6166ec8c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:37.472585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12f02fc-b756-4585-a139-380f6166ec8c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:37.506877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2d672-22e5-4cb1-a438-5753059e17c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:37.507559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d672-22e5-4cb1-a438-5753059e17c6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:37.507867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d672-22e5-4cb1-a438-5753059e17c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:37.508142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2d672-22e5-4cb1-a438-5753059e17c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:37.508890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2d672-22e5-4cb1-a438-5753059e17c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:37.509199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2d672-22e5-4cb1-a438-5753059e17c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:37.510579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2d672-22e5-4cb1-a438-5753059e17c6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:37.522746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 446/870] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:37.528273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:37.629979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1614e0-7f9f-45bd-ab79-1511524a39bb None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:37.667185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:37.668403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:37.668895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:37.669362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:37.680685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:37.682156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:37.692395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ecd3-5001-4bc3-93bc-8b569860a18f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:37.692871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ecd3-5001-4bc3-93bc-8b569860a18f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:37.692947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ecd3-5001-4bc3-93bc-8b569860a18f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:37.694569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 447/871] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:37.696727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:37.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:37.698460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 425/872] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:37.700684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27c8d-16b3-44f7-b495-8270cbd5d0ee None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:37.700975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27c8d-16b3-44f7-b495-8270cbd5d0ee None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:37.701253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca27c8d-16b3-44f7-b495-8270cbd5d0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:37.707900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:37.723872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-eca27c8d-16b3-44f7-b495-8270cbd5d0ee None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:37.725102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-eca27c8d-16b3-44f7-b495-8270cbd5d0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:37.740597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:37.759100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:37.803919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 448/873] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:37.823650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca27c8d-16b3-44f7-b495-8270cbd5d0ee None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:37.825424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f013-0b9d-422f-934a-54e9e10cd21d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:37.859191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:37.860211 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:37.860745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:37.861226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:37.862207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:37.862709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:37.864363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:37.877275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 426/874] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:37.883399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:37.929477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca27c8d-16b3-44f7-b495-8270cbd5d0ee None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:37.972720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:37.973960 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:37.974169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:37.974445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:37.975625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:37.977344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:37.996724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:37.997753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:37.998656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:37.999544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:37.999637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 449/875] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:38.004236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:38.005338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545ffa1-56fb-49b2-8d5a-769c8fa9ff93 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:38.023754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:38.055886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:38.056565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:38.056857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:38.057586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:38.058466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=7a35fb3434e64a259e8b9938ef38b32f) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:38.059169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:38.061274 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:38.069257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 427/876] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:37 2022] GET /identity/v3/role_assignments?user.id=7a35fb3434e64a259e8b9938ef38b32f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:38.127218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3216bd6-edb9-4c79-a4f8-117a16c4fcea None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:38.165012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75499d60-e82a-4f2a-8d59-6e0407d544cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:38.165695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75499d60-e82a-4f2a-8d59-6e0407d544cf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:38.165974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75499d60-e82a-4f2a-8d59-6e0407d544cf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:38.166248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75499d60-e82a-4f2a-8d59-6e0407d544cf None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:38.166985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75499d60-e82a-4f2a-8d59-6e0407d544cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:38.167288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75499d60-e82a-4f2a-8d59-6e0407d544cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:38.168767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75499d60-e82a-4f2a-8d59-6e0407d544cf None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:38.174525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 450/877] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:38.182364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:38.267692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31403b1-7008-42ee-a49b-4d0b85f8731a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:38.267692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31403b1-7008-42ee-a49b-4d0b85f8731a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:38.267692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31403b1-7008-42ee-a49b-4d0b85f8731a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:38.269526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 451/878] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:38.274903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0fd41-7347-438b-9d85-db4f2231b65b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:38.275195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0fd41-7347-438b-9d85-db4f2231b65b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:38.275468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0fd41-7347-438b-9d85-db4f2231b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:38.291299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f217-364b-4102-b76a-e58df272c628 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:38.298766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-19d0fd41-7347-438b-9d85-db4f2231b65b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:38.300173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-19d0fd41-7347-438b-9d85-db4f2231b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:38.332574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:38.333464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:38.333814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:38.334177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:38.335076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:38.335448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:38.336956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:38.342228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 428/879] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:38.383731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 452/880] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:38.406561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:38.437851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:38.518517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afb379-c8b5-49ad-8def-8b7fa217ea6e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:38.554078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbab890-0a9f-4d9e-be07-6dfa71d1b038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:38.555039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbab890-0a9f-4d9e-be07-6dfa71d1b038 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:38.555477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbab890-0a9f-4d9e-be07-6dfa71d1b038 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:38.555929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbab890-0a9f-4d9e-be07-6dfa71d1b038 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:38.556835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbab890-0a9f-4d9e-be07-6dfa71d1b038 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:38.558361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbab890-0a9f-4d9e-be07-6dfa71d1b038 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:38.576861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 429/881] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:28:38 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:38.913132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f0873-49eb-4260-8b9f-5fd9d57f8ce0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:38.913663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f0873-49eb-4260-8b9f-5fd9d57f8ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:38.913663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f0873-49eb-4260-8b9f-5fd9d57f8ce0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:38.915331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 453/882] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:38.920863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6504b3-de54-4bfe-9504-7bfcf6c4719e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:38.921151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6504b3-de54-4bfe-9504-7bfcf6c4719e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:38.921425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6504b3-de54-4bfe-9504-7bfcf6c4719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:38.938835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ee6504b3-de54-4bfe-9504-7bfcf6c4719e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:38.940064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ee6504b3-de54-4bfe-9504-7bfcf6c4719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:39.015545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 430/883] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:39.037398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f0873-49eb-4260-8b9f-5fd9d57f8ce0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:39.048729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:39.142143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f0873-49eb-4260-8b9f-5fd9d57f8ce0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:39.175970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:39.176696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:39.176970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:39.177290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:39.177952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:39.179364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:39.191708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:39.192677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:39.193505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:39.196504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 454/884] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:39.199213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6504b3-de54-4bfe-9504-7bfcf6c4719e None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:39.228396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:39.299401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6504b3-de54-4bfe-9504-7bfcf6c4719e None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:39.338877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:39.340094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:39.340577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:39.341073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:39.341983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:39.342495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:39.344104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:39.350412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 431/885] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:39.356187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:39.424605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:39.454538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7ae1a8-feec-4c4d-99fb-3fe4bd3e53ef None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:39.487046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:39.487737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:39.488017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:39.488290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:39.488997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:39.489295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:39.490655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:39.499707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 455/886] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:39.501640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:39.596517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:39.618559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446d7bd-c87a-4dc1-9223-0e4fffcca40f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:39.664244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54871e5e-cde4-4b08-b8e6-fd3f6949b1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:39.664986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871e5e-cde4-4b08-b8e6-fd3f6949b1aa None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:39.665273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871e5e-cde4-4b08-b8e6-fd3f6949b1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:39.665552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54871e5e-cde4-4b08-b8e6-fd3f6949b1aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:39.666412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871e5e-cde4-4b08-b8e6-fd3f6949b1aa None admin] RBAC: Adding query filter params (interface=public, service_id=ba59a91f08fb420588c614b36e48ee69, region_id=RegionOne) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:39.666736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871e5e-cde4-4b08-b8e6-fd3f6949b1aa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:39.668256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54871e5e-cde4-4b08-b8e6-fd3f6949b1aa None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:39.676346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 432/887] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 12 13:28:39 2022] GET /identity/v3/endpoints?service_id=ba59a91f08fb420588c614b36e48ee69&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:39.681998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:39.786227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5520c4b-d04c-4701-a1e5-086d3f67af7f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:39.820729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b53af-0fd3-46b4-b889-5f316d42c242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:39.821778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b53af-0fd3-46b4-b889-5f316d42c242 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:39.822261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b53af-0fd3-46b4-b889-5f316d42c242 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:39.822732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b53af-0fd3-46b4-b889-5f316d42c242 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:39.823745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b53af-0fd3-46b4-b889-5f316d42c242 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:39.825339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b53af-0fd3-46b4-b889-5f316d42c242 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:39.827481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:39.839754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 456/888] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:28:39 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:28:40.259426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85a45-c05d-4f62-aead-5cfe51f04f13 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.260009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85a45-c05d-4f62-aead-5cfe51f04f13 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.260009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e85a45-c05d-4f62-aead-5cfe51f04f13 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.261750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 433/889] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:40.267093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81bc3-8969-455a-b28d-d8251e1e12fc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.267524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81bc3-8969-455a-b28d-d8251e1e12fc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.267718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf81bc3-8969-455a-b28d-d8251e1e12fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.284861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ebf81bc3-8969-455a-b28d-d8251e1e12fc None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:40.286112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ebf81bc3-8969-455a-b28d-d8251e1e12fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:40.359781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 457/890] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:40.382982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e85a45-c05d-4f62-aead-5cfe51f04f13 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:40.490506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e85a45-c05d-4f62-aead-5cfe51f04f13 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:40.526082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f475-f050-4a78-b855-96ff608d8f04 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.526276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6539c44-08d6-4346-9ba5-a7554fa6c6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:40.526389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f475-f050-4a78-b855-96ff608d8f04 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.526644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8f475-f050-4a78-b855-96ff608d8f04 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.527163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6539c44-08d6-4346-9ba5-a7554fa6c6ce None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.527517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6539c44-08d6-4346-9ba5-a7554fa6c6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.527812 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6539c44-08d6-4346-9ba5-a7554fa6c6ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.531718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 458/891] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:40.533564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9173e-d6fd-4b3c-821b-8ad9c7be4163 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.534054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9173e-d6fd-4b3c-821b-8ad9c7be4163 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.534557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc9173e-d6fd-4b3c-821b-8ad9c7be4163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.543307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6539c44-08d6-4346-9ba5-a7554fa6c6ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-a6539c44-08d6-4346-9ba5-a7554fa6c6ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:40.551494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:40.552487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:40.553340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 434/892] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 12 13:28:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:40.559042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-edc9173e-d6fd-4b3c-821b-8ad9c7be4163 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:40.559042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-edc9173e-d6fd-4b3c-821b-8ad9c7be4163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:40.560273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6539c44-08d6-4346-9ba5-a7554fa6c6ce None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:40.563417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:40.639781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 459/893] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:40.639781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec427c36-547b-44a6-b5ba-9a44c95219a0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.639781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec427c36-547b-44a6-b5ba-9a44c95219a0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.639781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec427c36-547b-44a6-b5ba-9a44c95219a0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.644816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 460/894] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:40.647936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf6f9-02a7-4730-b27d-5c3f67cc713a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.647936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf6f9-02a7-4730-b27d-5c3f67cc713a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.648142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abf6f9-02a7-4730-b27d-5c3f67cc713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.675131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-46abf6f9-02a7-4730-b27d-5c3f67cc713a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:40.676386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-46abf6f9-02a7-4730-b27d-5c3f67cc713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:40.679851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6539c44-08d6-4346-9ba5-a7554fa6c6ce None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:40.714777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:40.715716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.715999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.716279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.717024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:40.717335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:40.718707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:40.731480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 435/895] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 12 13:28:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:40.731480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:40.739192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:40.751501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 461/896] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:40.752186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abf6f9-02a7-4730-b27d-5c3f67cc713a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:40.796828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:40.837103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff4e9d-a58f-4753-a3bb-c341deb6f897 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:40.870138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abf6f9-02a7-4730-b27d-5c3f67cc713a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:40.871411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b493f-639e-4af2-ab12-6334b377f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:40.872128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b493f-639e-4af2-ab12-6334b377f1f3 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.872412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b493f-639e-4af2-ab12-6334b377f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.873302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722b493f-639e-4af2-ab12-6334b377f1f3 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.873417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b493f-639e-4af2-ab12-6334b377f1f3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:40.874773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722b493f-639e-4af2-ab12-6334b377f1f3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:40.891754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 436/897] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:28:40 2022] POST /identity/v3/services => generated 241 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:40.891754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b493f-639e-4af2-ab12-6334b377f1f3 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:40.927077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:40.928341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:40.928829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:40.929471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:40.945002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:40.946708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:40.968790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:40.969760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:40.970636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:40.970636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:40.970636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:40.970636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:40.975722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 462/898] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:40.976367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.010499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722b493f-639e-4af2-ab12-6334b377f1f3 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.023643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:41.037457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:41.050570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.051695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.052124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.052540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.053399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.055059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:41.071395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:41.072404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:41.073232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 437/899] 10.222.0.64 () {56 vars in 1132 bytes} [Tue Jul 12 13:28:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:41.079473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.101164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e7366c-1315-4f58-a3e1-c4a8e3f57a70 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.138765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.139611 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.140185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.140465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.141205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:41.141527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.143342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.161177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 463/900] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:41.166024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.204798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892831f-26cf-4976-a99b-9453e8cc9a7b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.242080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.242762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.243037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.243315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.244058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:41.244369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.245752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.251186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 438/901] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:41.260849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.287354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:41.291123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f3768-eb3f-46ee-a07b-34dec4ba8ddd None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.318606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:41.334565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.335779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.336503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.337012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.347630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.349885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:41.370720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:41.371970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:41.372905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 464/902] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:28:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:41.378638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85aa92-b2ab-468b-9600-9237536c01e8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.380558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.424188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.425266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.425751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.426673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.427621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:41.428497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.430577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.443122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 439/903] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:41.444501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.493040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc57f72-7d8f-4117-95e3-0f25e988f950 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.533804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.534639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.535013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.535379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.536357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:41.536761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.538372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.562112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 465/904] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 12 13:28:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:41.563219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.572808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9e4e7-c5a3-4273-b1f4-7a44968abebe None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.586394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:41.591305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:41.612841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.613522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.613799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.614070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.614869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] RBAC: Adding query filter params (interface=public, service_id=8976de877636499797ff2474314d0d9f, region_id=RegionOne) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:41.615181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.617029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.626912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 440/905] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 12 13:28:41 2022] GET /identity/v3/endpoints?service_id=8976de877636499797ff2474314d0d9f&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:41.627946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.696127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c965076-73dc-49ce-9f24-dca685dd5dfb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.738813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045ff6c-330c-4de9-9e01-095e24481b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.739799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ff6c-330c-4de9-9e01-095e24481b6d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.740109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ff6c-330c-4de9-9e01-095e24481b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.740474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045ff6c-330c-4de9-9e01-095e24481b6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.743185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5336634-0192-4ac3-9b83-ec3ed45e6c5a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:41.785732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2874916-b31c-4fd6-914b-69065bd96adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:41.786649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2874916-b31c-4fd6-914b-69065bd96adb None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.787237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2874916-b31c-4fd6-914b-69065bd96adb None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.787717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2874916-b31c-4fd6-914b-69065bd96adb None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.788935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2874916-b31c-4fd6-914b-69065bd96adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.790872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2874916-b31c-4fd6-914b-69065bd96adb None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.807635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 441/906] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:28:41 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:28:41.822483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045ff6c-330c-4de9-9e01-095e24481b6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:41.824119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045ff6c-330c-4de9-9e01-095e24481b6d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:41.850437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:41.942160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 466/907] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:41 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:28:41.948381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2874916-b31c-4fd6-914b-69065bd96adb None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:41.975365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71980a-0e56-4c63-b3f6-b64da7225d2f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.975722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71980a-0e56-4c63-b3f6-b64da7225d2f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.975959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71980a-0e56-4c63-b3f6-b64da7225d2f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:41.977614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 467/908] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:41.983515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960669-6656-4a4f-ad4a-1dbe17d79bc1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:41.983515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960669-6656-4a4f-ad4a-1dbe17d79bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:41.984078 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1960669-6656-4a4f-ad4a-1dbe17d79bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.004940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d1960669-6656-4a4f-ad4a-1dbe17d79bc1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:42.006135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d1960669-6656-4a4f-ad4a-1dbe17d79bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:42.010679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:42.076230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2874916-b31c-4fd6-914b-69065bd96adb None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.093537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 468/909] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:42.115799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1960669-6656-4a4f-ad4a-1dbe17d79bc1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:42.118307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.119407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.119844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.120250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.132429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.134233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:42.154112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:42.155025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:42.155970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:42.155970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:42.155970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:42.155970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:42.158069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 442/910] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:42.166040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:42.168424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:42.238085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1960669-6656-4a4f-ad4a-1dbe17d79bc1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.273919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.275123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.275627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.276047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.276863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.278517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:42.279830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.285276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be61a8-0d11-4436-97b3-854e5d8ecc46 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:42.293818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:42.295319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 13:28:42.296313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:42.299108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 469/911] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:42.307738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:42.325876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.326628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.326861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.327137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.327910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:42.328221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.329910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.348659 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 443/912] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:42.355589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:42.427728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d23fb-b904-4e9d-a0fe-26411325eddf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.439472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:42.464783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.465640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.465768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.465995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.466709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:42.467016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.468423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.478248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 470/913] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:42.479398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:42.492444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945f451-ad97-46a7-a71d-fbf8b7c59946 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.527732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.528548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.528829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.529104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.536673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.538141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:42.553053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:42.554003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:42.555061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 444/914] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:42.561139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:42.583368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:42.612054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07225759-68e1-4522-ae1c-cc1501bda3f8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.658531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.659364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.659827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.660219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.661257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:42.661678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.664043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.671680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 471/915] 10.222.0.64 () {56 vars in 1114 bytes} [Tue Jul 12 13:28:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:42.677585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:42.691318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196833-918c-49bf-b04e-2c4d334e4bd7 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.732064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:42.732439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.733294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.733419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.733689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.734842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:42.735156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.736866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.752570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 445/916] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:42.758432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:42.810977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e39d-b1b8-4012-a045-0e6c1386b437 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.853347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:42.856516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a2e27-bfdf-4b04-b026-573292cd627e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.857845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2e27-bfdf-4b04-b026-573292cd627e None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.859464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2e27-bfdf-4b04-b026-573292cd627e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.859911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a2e27-bfdf-4b04-b026-573292cd627e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.861075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a2e27-bfdf-4b04-b026-573292cd627e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.863246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a2e27-bfdf-4b04-b026-573292cd627e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.881205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cb624-10de-4e71-9b07-d4145936be02 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:42.896431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 472/917] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:28:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:28:42.933484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cab3792-ff84-49bf-ba20-454dc54eb21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:42.934333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab3792-ff84-49bf-ba20-454dc54eb21f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:42.934978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab3792-ff84-49bf-ba20-454dc54eb21f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:42.935244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cab3792-ff84-49bf-ba20-454dc54eb21f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:42.936171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab3792-ff84-49bf-ba20-454dc54eb21f None admin] RBAC: Adding query filter params (role.id=e772014e2905402e827af855e6bcd2b5, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=7a35fb3434e64a259e8b9938ef38b32f) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:42.936488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab3792-ff84-49bf-ba20-454dc54eb21f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:42.938008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cab3792-ff84-49bf-ba20-454dc54eb21f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:42.945162 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 446/918] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:42 2022] GET /identity/v3/role_assignments?user.id=7a35fb3434e64a259e8b9938ef38b32f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=e772014e2905402e827af855e6bcd2b5 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:43.039963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52f5d-b102-4eb0-a0e3-e2894fbf801e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.040473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52f5d-b102-4eb0-a0e3-e2894fbf801e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.040855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d52f5d-b102-4eb0-a0e3-e2894fbf801e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.042865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 473/919] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:43.049408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d359d8-d23b-4f71-bde9-87ecc51b2f74 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.049838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d359d8-d23b-4f71-bde9-87ecc51b2f74 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.050204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d359d8-d23b-4f71-bde9-87ecc51b2f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.069920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-a5d359d8-d23b-4f71-bde9-87ecc51b2f74 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:43.071356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a5d359d8-d23b-4f71-bde9-87ecc51b2f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:43.152922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 447/920] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:43.179043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d52f5d-b102-4eb0-a0e3-e2894fbf801e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:43.279567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:43.289470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d52f5d-b102-4eb0-a0e3-e2894fbf801e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:43.326557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:43.328132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.328616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.329047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.329862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:43.331376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:43.344345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:43.345702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:43.346820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:43.349512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 474/921] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:43.356469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d359d8-d23b-4f71-bde9-87ecc51b2f74 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:43.430965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:43.469094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d359d8-d23b-4f71-bde9-87ecc51b2f74 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:43.506623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:43.507587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.508050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.508476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.509348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:43.509805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:43.511337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:43.517101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 448/922] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:43.522935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:43.625921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a65e82d-2477-45f1-b56b-f0d9d4e540b0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:43.660915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:43.661599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.661881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.662159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.662889 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:43.663197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:43.664617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:43.670454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 475/923] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:43.676400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:43.782454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd36ff88-fc0e-42d6-8a47-08117b049e46 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:43.812425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:43.818512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294d43b-9dde-433b-ae3e-dcc934bab834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:43.819189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d43b-9dde-433b-ae3e-dcc934bab834 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.819473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d43b-9dde-433b-ae3e-dcc934bab834 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.819783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294d43b-9dde-433b-ae3e-dcc934bab834 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.820792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294d43b-9dde-433b-ae3e-dcc934bab834 None admin] RBAC: Adding query filter params (interface=public, service_id=34a91168661247a89b35544633b0efad, region_id=RegionOne) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:43.821347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294d43b-9dde-433b-ae3e-dcc934bab834 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:43.823008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d294d43b-9dde-433b-ae3e-dcc934bab834 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:43.828788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 449/924] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 12 13:28:43 2022] GET /identity/v3/endpoints?service_id=34a91168661247a89b35544633b0efad&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:43.834158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:43.860421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:43.919242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66d236-366c-4b5e-b846-0e64bdd9913d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.919732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66d236-366c-4b5e-b846-0e64bdd9913d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.920119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66d236-366c-4b5e-b846-0e64bdd9913d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.921863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 450/925] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:43.926652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602dcdc-0435-40f4-8b07-a125024a738a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.927034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602dcdc-0435-40f4-8b07-a125024a738a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.927440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6602dcdc-0435-40f4-8b07-a125024a738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.939097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da9c55-1573-4935-a6b7-8ea62722cf73 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:43.946573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6602dcdc-0435-40f4-8b07-a125024a738a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:43.947922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6602dcdc-0435-40f4-8b07-a125024a738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:43.974054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c572b-3795-4a8a-8b5a-ff8e3f5c6679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:43.974989 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c572b-3795-4a8a-8b5a-ff8e3f5c6679 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:43.975416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c572b-3795-4a8a-8b5a-ff8e3f5c6679 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:43.975876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c572b-3795-4a8a-8b5a-ff8e3f5c6679 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:43.976726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c572b-3795-4a8a-8b5a-ff8e3f5c6679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:43.978252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c572b-3795-4a8a-8b5a-ff8e3f5c6679 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:43.985422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 476/926] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:28:43 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:28:44.021794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 451/927] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:44.045158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c572b-3795-4a8a-8b5a-ff8e3f5c6679 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:44.139191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:44.155267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c572b-3795-4a8a-8b5a-ff8e3f5c6679 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:44.191181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:44.192056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:44.192330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:44.192599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:44.193267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:44.194660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:44.207733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:44.208888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:44.209728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 477/928] 10.222.0.64 () {56 vars in 1132 bytes} [Tue Jul 12 13:28:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:44.215400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602dcdc-0435-40f4-8b07-a125024a738a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:44.320804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6602dcdc-0435-40f4-8b07-a125024a738a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:44.347023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:44.362353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:44.363172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:44.363348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:44.363546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:44.364662 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:44.365384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:44.366753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:44.374087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 452/929] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:44.379388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:44.480103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f5297a-fa47-4063-904c-e2fbee3c3265 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:44.513529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3745c8c-1dc2-47b8-9273-01368b19e8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:44.514208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3745c8c-1dc2-47b8-9273-01368b19e8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:44.514491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3745c8c-1dc2-47b8-9273-01368b19e8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:44.514767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3745c8c-1dc2-47b8-9273-01368b19e8f8 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:44.515486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3745c8c-1dc2-47b8-9273-01368b19e8f8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:44.515872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3745c8c-1dc2-47b8-9273-01368b19e8f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:44.517244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3745c8c-1dc2-47b8-9273-01368b19e8f8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:44.522232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 478/930] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:44.528334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:44.636124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72607e2b-68dd-4660-82b0-be29a9ea4c19 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:44.684066 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d514c-1cea-43dd-8ce6-57960d6d4d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:44.685127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d514c-1cea-43dd-8ce6-57960d6d4d39 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:44.685408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d514c-1cea-43dd-8ce6-57960d6d4d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:44.685679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d514c-1cea-43dd-8ce6-57960d6d4d39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:44.686626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d514c-1cea-43dd-8ce6-57960d6d4d39 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:44.688200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d514c-1cea-43dd-8ce6-57960d6d4d39 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:44.713819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 453/931] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:28:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:45.069692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23e12-00cd-4ba5-a746-e49927e6ac92 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.070063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23e12-00cd-4ba5-a746-e49927e6ac92 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.070254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e23e12-00cd-4ba5-a746-e49927e6ac92 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.071938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 479/932] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:45.077422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd5267-f68c-4c97-a17c-e8718f133f6d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.077717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd5267-f68c-4c97-a17c-e8718f133f6d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.077987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddd5267-f68c-4c97-a17c-e8718f133f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.096054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0ddd5267-f68c-4c97-a17c-e8718f133f6d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:45.097312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0ddd5267-f68c-4c97-a17c-e8718f133f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:45.140413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:45.152530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8884-b590-4de0-8a0f-c23af45b1b6e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.152825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8884-b590-4de0-8a0f-c23af45b1b6e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.153098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc8884-b590-4de0-8a0f-c23af45b1b6e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.155135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 480/933] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:45.160760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0df9-109e-43f5-8566-936bd48c7a22 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.161571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0df9-109e-43f5-8566-936bd48c7a22 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.162458 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b0df9-109e-43f5-8566-936bd48c7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.180522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-740b0df9-109e-43f5-8566-936bd48c7a22 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:45.181792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-740b0df9-109e-43f5-8566-936bd48c7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:45.183746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 454/934] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:45.197816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:45.204514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd5267-f68c-4c97-a17c-e8718f133f6d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:45.268747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 481/935] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:45.291261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0df9-109e-43f5-8566-936bd48c7a22 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:45.313333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddd5267-f68c-4c97-a17c-e8718f133f6d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:45.350939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc50d7-af3a-4c2a-b0d8-db592f8436b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:45.351888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc50d7-af3a-4c2a-b0d8-db592f8436b8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.352083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc50d7-af3a-4c2a-b0d8-db592f8436b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.352362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc50d7-af3a-4c2a-b0d8-db592f8436b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.363132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc50d7-af3a-4c2a-b0d8-db592f8436b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-0bdc50d7-af3a-4c2a-b0d8-db592f8436b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:45.371408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:45.372453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:28:45.373332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:45.377832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 455/936] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 12 13:28:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:45.378728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc50d7-af3a-4c2a-b0d8-db592f8436b8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:45.417569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:45.421835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740b0df9-109e-43f5-8566-936bd48c7a22 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:45.463347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:45.464217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.464509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.464842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.465588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:45.467694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:45.468709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING keystone.server.flask.common [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 13:28:45.483896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:45.488514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.sql.core [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 13:28:45.488514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 13:28:45.488514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [parameters: {'id': '6dfbb8382e0844c68eb5814905d96cf6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 13:28:45.488514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80481) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 13:28:45.504317 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc50d7-af3a-4c2a-b0d8-db592f8436b8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6dfbb8382e0844c68eb5814905d96cf6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6dfbb8382e0844c68eb5814905d96cf6. Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:28:45.508275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result.read() Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 13:28:45.509162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application yield resource Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise self.value Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application session.commit() Jul 12 13:28:45.510110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.session.flush() Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application compat.raise_( Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 13:28:45.511555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 13:28:45.512685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application result.read() Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:28:45.513466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [parameters: {'id': '6dfbb8382e0844c68eb5814905d96cf6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:45.515046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:45.516894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6dfbb8382e0844c68eb5814905d96cf6. Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 482/937] 10.222.0.64 () {60 vars in 1140 bytes} [Tue Jul 12 13:28:45 2022] POST /identity/v3/projects => generated 262 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:45.518937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:45.555471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:45.556564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.557035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.557534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.558502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:45.559110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:45.561172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:45.570749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 456/938] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 12 13:28:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:45.576818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:45.641725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c1ed9-67b9-483a-b045-8259db0b6dc8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:45.686522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:45.687340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.687645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.687937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.695158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:45.696927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:45.702159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:45.712564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b908c-e292-43be-83b1-dc8416e519da None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:45.712720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:45.713570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:45.714437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:45.714437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:45.714437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:45.714437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:45.714437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:45.714437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:45.714437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:45.714437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:45.718969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 483/939] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:45.719871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:45.759186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:45.760432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.760924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.761405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.776464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:45.778865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:45.784621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:45.798938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:45.800177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:45.801054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:45.801054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:45.801054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:45.801054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:45.804958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 457/940] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:45.805838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:45.852616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b72fb-1c5f-4963-9431-cf30756c1fc2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:45.897690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:45.899090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.899579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.900335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.902082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:45.902680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:45.905286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:45.910065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c38a94-b971-4a6b-9412-fcc711f64d81 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:45.932338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 484/941] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:45.954859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db8d73-8577-4f72-889d-657d7db57b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:45.955561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8d73-8577-4f72-889d-657d7db57b1f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:45.955889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8d73-8577-4f72-889d-657d7db57b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:45.956337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db8d73-8577-4f72-889d-657d7db57b1f None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:45.957113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db8d73-8577-4f72-889d-657d7db57b1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:45.957429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db8d73-8577-4f72-889d-657d7db57b1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:45.958966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db8d73-8577-4f72-889d-657d7db57b1f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:45.974584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 458/942] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:45.980027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.095121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294c575-fb66-4f2c-8176-69f677b68c33 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.116657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:46.118177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03e96-2688-4f28-a246-5513ee44ecce None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.118523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03e96-2688-4f28-a246-5513ee44ecce None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.118759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a03e96-2688-4f28-a246-5513ee44ecce None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.120325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 459/943] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:46.127265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db80a2-494f-4e13-bd14-65db1f7a918a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.127558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db80a2-494f-4e13-bd14-65db1f7a918a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.127868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db80a2-494f-4e13-bd14-65db1f7a918a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.135161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.135967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.136251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.136545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.142328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:46.144869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.145928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:46.155165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-70db80a2-494f-4e13-bd14-65db1f7a918a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:46.156516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-70db80a2-494f-4e13-bd14-65db1f7a918a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:46.161253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:46.162209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:46.163144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 485/944] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:28:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:46.169842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.242727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 460/945] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:46.271257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db80a2-494f-4e13-bd14-65db1f7a918a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.283936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46067cac-0285-48a6-9656-fc54894b70f7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.319039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.320197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.320736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.321213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.322255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:46.322775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.324503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:46.344473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 486/946] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 12 13:28:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:46.350254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.383183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db80a2-494f-4e13-bd14-65db1f7a918a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.404406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:46.425939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.426692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.426976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.427254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.427966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.429634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:46.431724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:46.446673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:46.448090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:46.448989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 461/947] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:46.458215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.483075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b039c55-b69e-47f3-a9bb-f18f325e6f3e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.525530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.526737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.527284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.528296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.543014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.545088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:46.569958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:46.570924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:46.571951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:46.571951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:46.571951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:46.571951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:46.573967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 487/948] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:46.582737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.586088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21836b42-5160-4513-8e18-9c768020a37c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.629847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.631386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.631905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.632795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.634012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:46.634521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.637097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:46.644144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 462/949] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:46.649390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.691286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:46.706330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6490bb-0d55-4088-9004-0672a3cd2173 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.728777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:46.752095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.753392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.753950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.754557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.755917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:46.756430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.758437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:46.772646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f7930-20a1-44d6-a895-09f746adaa34 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.778675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 488/950] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:46.780338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.813565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.814240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.814520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.814794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.815507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:46.815842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.817218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:46.827293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 463/951] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:46.828333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.892575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b267fdb-77e6-4d2a-bba9-a7d514d233bb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.926930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2ac90-7e7b-4241-aa49-444189cad253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.927771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ac90-7e7b-4241-aa49-444189cad253 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.928071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ac90-7e7b-4241-aa49-444189cad253 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.928338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2ac90-7e7b-4241-aa49-444189cad253 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.931038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371c3b9-c61d-42fb-b59d-7c38600bd4d1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:46.935648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2ac90-7e7b-4241-aa49-444189cad253 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.937080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2ac90-7e7b-4241-aa49-444189cad253 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-1df2ac90-7e7b-4241-aa49-444189cad253 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:46.951403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:46.952427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:46.953334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 489/952] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:46.954159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2469d11-332e-4852-9cd4-38a6068c8fd8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.954229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2469d11-332e-4852-9cd4-38a6068c8fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.954478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2469d11-332e-4852-9cd4-38a6068c8fd8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.955947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 490/953] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:46.960515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2469d11-332e-4852-9cd4-38a6068c8fd8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:46.963046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:46.972907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:46.974958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d115f7a-838f-49ac-958e-47eb2355055c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:46.975881 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115f7a-838f-49ac-958e-47eb2355055c None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:46.976076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115f7a-838f-49ac-958e-47eb2355055c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:46.976388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d115f7a-838f-49ac-958e-47eb2355055c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:46.977139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d115f7a-838f-49ac-958e-47eb2355055c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:46.978553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d115f7a-838f-49ac-958e-47eb2355055c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:47.007627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 464/954] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:28:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:47.007627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c970-94d2-42e6-a50d-aedce9c71075 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:47.007627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c970-94d2-42e6-a50d-aedce9c71075 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:47.007627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8c970-94d2-42e6-a50d-aedce9c71075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:47.025408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6bc8c970-94d2-42e6-a50d-aedce9c71075 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:47.026798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6bc8c970-94d2-42e6-a50d-aedce9c71075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:47.097436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2469d11-332e-4852-9cd4-38a6068c8fd8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:47.119070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 465/955] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:47.141616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8c970-94d2-42e6-a50d-aedce9c71075 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:47.142278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:47.143189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:47.143742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:47.144680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:47.146981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:47.147618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:47.149324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:47.167463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 491/956] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:47.175738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:47.269284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:47.276940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8c970-94d2-42e6-a50d-aedce9c71075 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:47.291926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:47.311704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5512d3-51cc-4ad3-ad9f-88a882623fb2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:47.315368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:47.316294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:47.316638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:47.316975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:47.317695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:47.319127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:47.330982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:47.332030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:47.332887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 466/957] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:47.339975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:47.356771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23568-03b7-48b2-be81-4aecff02eb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:47.358107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23568-03b7-48b2-be81-4aecff02eb01 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:47.358478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23568-03b7-48b2-be81-4aecff02eb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:47.358844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf23568-03b7-48b2-be81-4aecff02eb01 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/7a35fb3434e64a259e8b9938ef38b32f/roles/e772014e2905402e827af855e6bcd2b5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:47.361898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23568-03b7-48b2-be81-4aecff02eb01 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=7a35fb3434e64a259e8b9938ef38b32f, role_id=e772014e2905402e827af855e6bcd2b5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:47.363867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf23568-03b7-48b2-be81-4aecff02eb01 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:47.381851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 492/958] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:28:47 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/7a35fb3434e64a259e8b9938ef38b32f/roles/e772014e2905402e827af855e6bcd2b5 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:28:47.470421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f6d7c9-cc42-4aac-970b-75a0874b7e49 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:47.507838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384e450-91cf-45b9-9f6a-6368f816640a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:47.508546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384e450-91cf-45b9-9f6a-6368f816640a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:47.508832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384e450-91cf-45b9-9f6a-6368f816640a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:47.509104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384e450-91cf-45b9-9f6a-6368f816640a None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:47.509838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384e450-91cf-45b9-9f6a-6368f816640a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:47.510137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384e450-91cf-45b9-9f6a-6368f816640a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:47.511533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384e450-91cf-45b9-9f6a-6368f816640a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:47.517742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 467/959] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:47.523653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23568-03b7-48b2-be81-4aecff02eb01 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:47.631293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf23568-03b7-48b2-be81-4aecff02eb01 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:47.657884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:47.667421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c80a2e-694c-4804-b7b0-b0cc0c0a9656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:47.668535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c80a2e-694c-4804-b7b0-b0cc0c0a9656 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:47.668972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c80a2e-694c-4804-b7b0-b0cc0c0a9656 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:47.669599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c80a2e-694c-4804-b7b0-b0cc0c0a9656 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:47.670480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c80a2e-694c-4804-b7b0-b0cc0c0a9656 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:47.670943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c80a2e-694c-4804-b7b0-b0cc0c0a9656 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:47.672583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c80a2e-694c-4804-b7b0-b0cc0c0a9656 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:47.684087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 493/960] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:48.086436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c6d1c-4342-4f46-9bd7-b51de27624b4 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:48.086834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c6d1c-4342-4f46-9bd7-b51de27624b4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:48.087034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c6d1c-4342-4f46-9bd7-b51de27624b4 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:48.088632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 468/961] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:48.094170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fc92e-1326-4c17-9a77-b6fa6f1a543a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:48.094469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fc92e-1326-4c17-9a77-b6fa6f1a543a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:48.094750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222fc92e-1326-4c17-9a77-b6fa6f1a543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:48.111861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-222fc92e-1326-4c17-9a77-b6fa6f1a543a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:48.113379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-222fc92e-1326-4c17-9a77-b6fa6f1a543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:48.181391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 494/962] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:48.206063 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c6d1c-4342-4f46-9bd7-b51de27624b4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:48.256702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:48.317175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c6d1c-4342-4f46-9bd7-b51de27624b4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:48.351400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:48.352029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:48.352313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:48.352588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:48.353306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:48.354744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:48.356325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING keystone.server.flask.common [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 13:28:48.368840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.sql.core [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 13:28:48.368840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 13:28:48.368840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [parameters: {'user_id': 'bf505530015b40b8bc19e3b735a8b7f4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 13:28:48.368840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80482) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result.read() Jul 12 13:28:48.376754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:28:48.377655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application yield resource Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application next(self.gen) Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise self.value Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application session.commit() Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 13:28:48.379366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.session.flush() Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application compat.raise_( Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 13:28:48.380314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 13:28:48.382294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application conn.query(q) Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application result.read() Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 13:28:48.385224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bf505530015b40b8bc19e3b735a8b7f4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:48.386840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 13:28:48.387947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 13:28:48.389078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 13:28:48.389078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 13:28:48.389078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 13:28:48.389078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 13:28:48.389078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 13:28:48.389078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:48.389078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 469/963] 10.222.0.64 () {60 vars in 1131 bytes} [Tue Jul 12 13:28:48 2022] POST /identity/v3/users => generated 160 bytes in 173 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:48.389557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fc92e-1326-4c17-9a77-b6fa6f1a543a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:48.490878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222fc92e-1326-4c17-9a77-b6fa6f1a543a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:48.511998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:48.526204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb6223-0c93-4bf7-be75-3fd90b7e999f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:48.527096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb6223-0c93-4bf7-be75-3fd90b7e999f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:48.527414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb6223-0c93-4bf7-be75-3fd90b7e999f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:48.527720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb6223-0c93-4bf7-be75-3fd90b7e999f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:48.535137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb6223-0c93-4bf7-be75-3fd90b7e999f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:48.536626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb6223-0c93-4bf7-be75-3fd90b7e999f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-b9eb6223-0c93-4bf7-be75-3fd90b7e999f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:48.551283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:48.552257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:48.553799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 495/964] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:28:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:48.561310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:48.666540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044389-09c7-4797-9050-0a34d9e6b90c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:48.688124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:48.704035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8b69f-1710-41fb-aad9-9037bff73fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:48.704737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b69f-1710-41fb-aad9-9037bff73fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:48.705021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b69f-1710-41fb-aad9-9037bff73fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:48.705298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b69f-1710-41fb-aad9-9037bff73fc9 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:48.706315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8b69f-1710-41fb-aad9-9037bff73fc9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:48.706951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8b69f-1710-41fb-aad9-9037bff73fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:48.708830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8b69f-1710-41fb-aad9-9037bff73fc9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:48.747406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 470/965] 10.222.0.64 () {56 vars in 1101 bytes} [Tue Jul 12 13:28:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:49.223093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2f0f-5a83-4ebc-90dd-9c48a581c523 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.223354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2f0f-5a83-4ebc-90dd-9c48a581c523 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.223650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e2f0f-5a83-4ebc-90dd-9c48a581c523 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.225034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 496/966] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:49.230712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9f26d-916d-4424-a56d-f40d236bedaa None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.231006 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9f26d-916d-4424-a56d-f40d236bedaa None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.231243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9f26d-916d-4424-a56d-f40d236bedaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.248813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ccf9f26d-916d-4424-a56d-f40d236bedaa None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:49.250342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ccf9f26d-916d-4424-a56d-f40d236bedaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:49.322838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 471/967] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:49.345540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2f0f-5a83-4ebc-90dd-9c48a581c523 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:49.451830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e2f0f-5a83-4ebc-90dd-9c48a581c523 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:49.487369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:49.488133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.488415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.488690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.489355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:49.490719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:49.500758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f6fc-957d-41a7-b579-1c1fdf386583 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.501037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f6fc-957d-41a7-b579-1c1fdf386583 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.501304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f6fc-957d-41a7-b579-1c1fdf386583 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.502831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 472/968] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:49.502958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:49.509117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:49.509977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 497/969] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:49.510785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07173c51-7168-48a2-ab49-afc4d7b0761e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.510785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07173c51-7168-48a2-ab49-afc4d7b0761e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.510785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07173c51-7168-48a2-ab49-afc4d7b0761e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.510967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:49.526139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-07173c51-7168-48a2-ab49-afc4d7b0761e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:49.527380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-07173c51-7168-48a2-ab49-afc4d7b0761e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:49.558170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:49.599825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 473/970] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:49.623163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8fe481-d132-4ee3-b3d5-a2e21492c823 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:49.623458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07173c51-7168-48a2-ab49-afc4d7b0761e None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:49.647649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:49.665904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:49.666579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.666856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.667126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.667904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:49.668213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:49.669571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:49.674777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 498/971] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:49.679953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:49.730850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07173c51-7168-48a2-ab49-afc4d7b0761e None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:49.764123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da267-4948-40c0-bdbf-11304fdfbacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:49.764875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da267-4948-40c0-bdbf-11304fdfbacd None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.765156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da267-4948-40c0-bdbf-11304fdfbacd None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.765436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da267-4948-40c0-bdbf-11304fdfbacd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.775722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9da267-4948-40c0-bdbf-11304fdfbacd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ba9da267-4948-40c0-bdbf-11304fdfbacd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:49.783809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:49.784810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:28:49.785678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:49.786334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a06ed-cf01-463d-805a-6cb317f9aa44 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:49.786409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 474/972] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 12 13:28:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:49.786409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844a3e-d484-47e6-80fd-c86c4e064568 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.786540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844a3e-d484-47e6-80fd-c86c4e064568 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.786710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef844a3e-d484-47e6-80fd-c86c4e064568 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.788141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 475/973] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:49.790923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef844a3e-d484-47e6-80fd-c86c4e064568 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:49.797554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:49.822486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61246311-c451-4baa-9989-407c07818c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:49.823144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61246311-c451-4baa-9989-407c07818c0d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.823440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61246311-c451-4baa-9989-407c07818c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.823818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61246311-c451-4baa-9989-407c07818c0d None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.824546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61246311-c451-4baa-9989-407c07818c0d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:49.824881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61246311-c451-4baa-9989-407c07818c0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:49.826241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61246311-c451-4baa-9989-407c07818c0d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:49.831026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 499/974] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:49.832258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650390f7-0604-483a-a457-1e2ec357096f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.832542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650390f7-0604-483a-a457-1e2ec357096f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.832818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650390f7-0604-483a-a457-1e2ec357096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.848400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-650390f7-0604-483a-a457-1e2ec357096f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:49.849570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-650390f7-0604-483a-a457-1e2ec357096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:49.872270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:49.891810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef844a3e-d484-47e6-80fd-c86c4e064568 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:49.913162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 500/975] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:49.913815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650390f7-0604-483a-a457-1e2ec357096f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:49.929760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:49.930604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:49.930886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:49.931160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:49.931948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:49.932256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:49.933691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:49.943419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 476/976] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 12 13:28:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:49.944224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:50.019392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650390f7-0604-483a-a457-1e2ec357096f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:50.020945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:50.042608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b977476-b665-4ae5-8f71-8e087811ad5a None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:50.053367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:50.054033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:50.054317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:50.054592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:50.055402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] RBAC: Adding query filter params (interface=admin, service_id=34a91168661247a89b35544633b0efad, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:50.055745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:50.057110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:50.062578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 501/977] 10.222.0.64 () {56 vars in 1249 bytes} [Tue Jul 12 13:28:49 2022] GET /identity/v3/endpoints?service_id=34a91168661247a89b35544633b0efad&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:50.063337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:50.076202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931034d-e198-4045-a27a-b486fed3ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:50.076876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931034d-e198-4045-a27a-b486fed3ce1b None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:50.077157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931034d-e198-4045-a27a-b486fed3ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:50.077431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931034d-e198-4045-a27a-b486fed3ce1b None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:50.078155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931034d-e198-4045-a27a-b486fed3ce1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:50.079531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931034d-e198-4045-a27a-b486fed3ce1b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:50.093921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 477/978] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:28:49 2022] POST /identity/v3/services => generated 242 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:50.094705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931034d-e198-4045-a27a-b486fed3ce1b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:50.097209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:50.184012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d8919-d2a4-48c7-8919-3f79b69e4d27 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:50.229380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:50.229789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931034d-e198-4045-a27a-b486fed3ce1b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:50.230203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:50.230530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:50.230803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:50.243869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:50.245602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:50.264436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:50.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:50.266265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:50.266265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:50.266265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:50.266265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:50.266265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 502/979] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:50.270930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:50.271455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fc1a0-9404-48b6-9d5b-bea7a5982a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:50.272383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc1a0-9404-48b6-9d5b-bea7a5982a48 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:50.273131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc1a0-9404-48b6-9d5b-bea7a5982a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:50.273131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fc1a0-9404-48b6-9d5b-bea7a5982a48 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:50.273627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fc1a0-9404-48b6-9d5b-bea7a5982a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:50.276218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fc1a0-9404-48b6-9d5b-bea7a5982a48 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:50.285324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 478/980] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:28:50 2022] GET /identity/v3/services => generated 1727 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:28:50.289028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:50.384403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8be478-9cd4-4cfb-8bc2-3eac6a7bf61b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:50.421402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:50.422086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:50.422368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:50.422641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:50.423392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:50.423734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:50.425131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:50.439119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 503/981] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:50.443965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fc1a0-9404-48b6-9d5b-bea7a5982a48 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:50.514772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:50.555503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fc1a0-9404-48b6-9d5b-bea7a5982a48 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:50.591547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:50.592410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:50.592669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:50.592955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:50.601231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:50.602682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:50.617803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:50.618782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 13:28:50.620547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:50.621324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 479/982] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:28:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:50.625010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:50.715478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:50.742245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01acf1c6-5e6e-4e6f-99ef-4d431cd9d5e3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:50.777966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:50.778646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:50.778926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:50.779203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:50.780083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:50.780398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:50.781842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:50.799635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 504/983] 10.222.0.64 () {56 vars in 1149 bytes} [Tue Jul 12 13:28:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:50.805317 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:50.911205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66399698-aac8-4011-bb35-17f49da4249f None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:50.933674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:50.947271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e711b-8e6d-4504-95a2-e6e6248f51ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:50.947962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e711b-8e6d-4504-95a2-e6e6248f51ef None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:50.948244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e711b-8e6d-4504-95a2-e6e6248f51ef None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:50.948518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e711b-8e6d-4504-95a2-e6e6248f51ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:51.014495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e711b-8e6d-4504-95a2-e6e6248f51ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:51.015973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e711b-8e6d-4504-95a2-e6e6248f51ef None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:51.116332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 480/984] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:50 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:28:51.122313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:51.228810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148ec7-1e92-436e-9def-5c147429042e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:51.259889 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:51.266285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:51.267108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:51.267389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:51.267710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:51.278294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:51.279780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:51.297987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:51.298912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:51.300013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:51.300013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:51.300013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:51.300013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:51.300013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 505/985] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:51.305987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e711b-8e6d-4504-95a2-e6e6248f51ef None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:51.330747 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:51.410341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e711b-8e6d-4504-95a2-e6e6248f51ef None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:51.447717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:51.448392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:51.448677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:51.448924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:51.449809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:51.450117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:51.451490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:51.463515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 481/986] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:51.469114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:51.575214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5532a-d97c-4bbe-9266-4b4508c9a494 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:51.608661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:51.609466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:51.609746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:51.610021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:51.616731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:51.618178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:28:51.631685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:51.633019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:51.633916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 506/987] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:51.640486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:51.730075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:51.749610 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f38c0d-9934-4a6f-9d5f-6c1dd8646ba8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:51.784178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef6342-1a89-4307-bafd-2bb6185fc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:51.784852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6342-1a89-4307-bafd-2bb6185fc5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:51.785135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6342-1a89-4307-bafd-2bb6185fc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:51.785403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef6342-1a89-4307-bafd-2bb6185fc5a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:51.786230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6342-1a89-4307-bafd-2bb6185fc5a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:51.786540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6342-1a89-4307-bafd-2bb6185fc5a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:51.788050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef6342-1a89-4307-bafd-2bb6185fc5a9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:51.805966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 482/988] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:28:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:51.807228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:51.855983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:51.913915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5064e9-a145-449d-b910-2111e30a619f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:51.949415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05842473-6830-46d3-ba3a-e56b48139914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:51.950107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05842473-6830-46d3-ba3a-e56b48139914 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:51.950384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05842473-6830-46d3-ba3a-e56b48139914 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:51.950669 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05842473-6830-46d3-ba3a-e56b48139914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:51.951520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05842473-6830-46d3-ba3a-e56b48139914 None admin] RBAC: Adding query filter params (role.id=e772014e2905402e827af855e6bcd2b5, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=7a35fb3434e64a259e8b9938ef38b32f) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:51.951888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05842473-6830-46d3-ba3a-e56b48139914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:51.953338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05842473-6830-46d3-ba3a-e56b48139914 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:51.959488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 507/989] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:28:51 2022] GET /identity/v3/role_assignments?user.id=7a35fb3434e64a259e8b9938ef38b32f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=e772014e2905402e827af855e6bcd2b5 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:52.155738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8647-5a1b-450d-bf60-7f2bb5f8ef80 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.155924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8647-5a1b-450d-bf60-7f2bb5f8ef80 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.156211 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8647-5a1b-450d-bf60-7f2bb5f8ef80 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.157758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 483/990] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:52.162977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b447-f4cb-489a-a2ec-489d2d63d1d8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.163360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b447-f4cb-489a-a2ec-489d2d63d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.163868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01b447-f4cb-489a-a2ec-489d2d63d1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.181234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ca01b447-f4cb-489a-a2ec-489d2d63d1d8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:52.182428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ca01b447-f4cb-489a-a2ec-489d2d63d1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:52.251932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 508/991] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:52.274103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c8647-5a1b-450d-bf60-7f2bb5f8ef80 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:52.339982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762713-310a-4cd0-8de8-ac1fbb94d87a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.340302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762713-310a-4cd0-8de8-ac1fbb94d87a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.340708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b762713-310a-4cd0-8de8-ac1fbb94d87a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.342197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 509/992] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:52.347862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08adf9-e9b7-43c0-8b99-cd80e3e97891 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.348218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08adf9-e9b7-43c0-8b99-cd80e3e97891 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.348605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08adf9-e9b7-43c0-8b99-cd80e3e97891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.370046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0f08adf9-e9b7-43c0-8b99-cd80e3e97891 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:52.371290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0f08adf9-e9b7-43c0-8b99-cd80e3e97891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:52.386815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c8647-5a1b-450d-bf60-7f2bb5f8ef80 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:52.400484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:52.424152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:52.425645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.426086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.426520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.427188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:52.428677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:52.439410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 510/993] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:52.441129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:52.442149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:52.448226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 484/994] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:52.450694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08adf9-e9b7-43c0-8b99-cd80e3e97891 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:52.463462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:52.474134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:52.553543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08adf9-e9b7-43c0-8b99-cd80e3e97891 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:52.567420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381356bf-b58a-47da-a3fc-52b13e35e58d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:52.590704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:52.591761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.592218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.592669 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.593556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:52.594075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:52.595456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:52.603753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 511/995] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:52.604562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:52.605511 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.605836 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.606113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.606624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:52.606753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:52.608251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:52.620632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:52.621726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:52.622577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 485/996] 10.222.0.64 () {56 vars in 1126 bytes} [Tue Jul 12 13:28:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:52.627861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:52.642692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:52.706476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:52.722915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f563f-7bdd-4637-9a0e-6557290bf856 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:52.744548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32be8b92-44e6-49a0-9628-01e9949e03f8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:52.761127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:52.761988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.762405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.762631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.763349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:52.763678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:52.765066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:52.775480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 512/997] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:52.776362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:52.779138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:52.780342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.780342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.780342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.781072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:52.781377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:52.782754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:52.787887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 486/998] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:52.793380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:52.879974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:52.888133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52dc2b-efac-4313-8e32-354ae8e95862 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:52.892890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998d33-ec1a-41de-8ff7-7fb6500231a8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:52.922957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:52.923667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.923946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.924238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.925003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] RBAC: Adding query filter params (interface=public, service_id=2e300bc44c0e4f1ca661e78054f2b921, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:52.925312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:52.925419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:52.926038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:52.926325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:52.926601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:52.926705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:52.927319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:52.927654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:52.929062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:52.930355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:52.932756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 513/999] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 12 13:28:52 2022] GET /identity/v3/endpoints?service_id=2e300bc44c0e4f1ca661e78054f2b921&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:52.938883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:52.944589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 487/1000] 10.222.0.64 () {56 vars in 1122 bytes} [Tue Jul 12 13:28:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:52.945447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:53.039764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50bfae-36c0-4164-92bf-0d262ffcead8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:53.051312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392fc4-fd9a-4e06-929e-d10580a5ad65 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:53.076320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e369deb4-0245-456c-8278-1d7b95a14ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:53.077011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369deb4-0245-456c-8278-1d7b95a14ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:53.077293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369deb4-0245-456c-8278-1d7b95a14ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:53.077566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e369deb4-0245-456c-8278-1d7b95a14ea7 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:53.078270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369deb4-0245-456c-8278-1d7b95a14ea7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:53.079713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e369deb4-0245-456c-8278-1d7b95a14ea7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:53.086549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 514/1001] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:28:52 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:28:53.089350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369b41b-bee7-4187-bf1a-524703b4114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:53.090769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b41b-bee7-4187-bf1a-524703b4114b None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:53.091437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b41b-bee7-4187-bf1a-524703b4114b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:53.092176 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369b41b-bee7-4187-bf1a-524703b4114b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:53.093474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369b41b-bee7-4187-bf1a-524703b4114b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:53.095267 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369b41b-bee7-4187-bf1a-524703b4114b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:53.114556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 488/1002] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:28:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:54.011972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3402253-ede8-4d3e-928c-168c90fb6bd8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:54.012476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3402253-ede8-4d3e-928c-168c90fb6bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:54.012476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3402253-ede8-4d3e-928c-168c90fb6bd8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:54.013892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 515/1003] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:54.019143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31512f-0238-4067-8bdf-e694891bb0ba None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:54.019584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31512f-0238-4067-8bdf-e694891bb0ba None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:54.019694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa31512f-0238-4067-8bdf-e694891bb0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:54.036483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-aa31512f-0238-4067-8bdf-e694891bb0ba None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:54.037680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-aa31512f-0238-4067-8bdf-e694891bb0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:54.091948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:54.113760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 489/1004] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:54.135925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3402253-ede8-4d3e-928c-168c90fb6bd8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:54.162279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:54.243279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3402253-ede8-4d3e-928c-168c90fb6bd8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:54.279799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:54.280495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:54.280777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:54.281051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] PATH_INFO: `/v3/services/image` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:54.281707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:54.283072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:54.294588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:54.295576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:28:54.296459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:54.297999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 516/1005] 10.222.0.64 () {56 vars in 1105 bytes} [Tue Jul 12 13:28:54 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:54.301884 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31512f-0238-4067-8bdf-e694891bb0ba None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:54.400853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa31512f-0238-4067-8bdf-e694891bb0ba None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:54.434124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68388f04-1cd4-4b5b-933c-438ad5f5e8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:54.435164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68388f04-1cd4-4b5b-933c-438ad5f5e8da None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:54.435441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68388f04-1cd4-4b5b-933c-438ad5f5e8da None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:54.435741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68388f04-1cd4-4b5b-933c-438ad5f5e8da None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:54.436455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68388f04-1cd4-4b5b-933c-438ad5f5e8da None admin] RBAC: Adding query filter params (name=image) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:54.436760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68388f04-1cd4-4b5b-933c-438ad5f5e8da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:54.438131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68388f04-1cd4-4b5b-933c-438ad5f5e8da None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:54.443258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 490/1006] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:54.448761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:54.535370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:54.548507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9db74-d60e-4d46-9781-f32ac9372e83 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:54.583127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e5fce-01b3-413c-a987-8b3211795b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:54.584558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5fce-01b3-413c-a987-8b3211795b68 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:54.584842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5fce-01b3-413c-a987-8b3211795b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:54.585122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e5fce-01b3-413c-a987-8b3211795b68 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:54.585845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e5fce-01b3-413c-a987-8b3211795b68 None admin] RBAC: Adding query filter params (type=image) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:54.586153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e5fce-01b3-413c-a987-8b3211795b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:54.591962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506e5fce-01b3-413c-a987-8b3211795b68 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:54.597408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 517/1007] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:55.124589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027bdba-b885-410c-8650-4f80602e8601 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.125143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027bdba-b885-410c-8650-4f80602e8601 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.125143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027bdba-b885-410c-8650-4f80602e8601 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.126825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 491/1008] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:55.132037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f68a0-bad1-426f-80cd-713cc6c07813 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.132456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f68a0-bad1-426f-80cd-713cc6c07813 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.132646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f68a0-bad1-426f-80cd-713cc6c07813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.150601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cb5f68a0-bad1-426f-80cd-713cc6c07813 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:55.151820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cb5f68a0-bad1-426f-80cd-713cc6c07813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:55.176877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50083a44-03b7-4a84-83d7-97100857e867 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.177177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50083a44-03b7-4a84-83d7-97100857e867 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.177419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50083a44-03b7-4a84-83d7-97100857e867 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.178807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 492/1009] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:55.183713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da91e-2e29-4e2b-8be9-a48573290e71 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.184001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da91e-2e29-4e2b-8be9-a48573290e71 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.184279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224da91e-2e29-4e2b-8be9-a48573290e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.201726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-224da91e-2e29-4e2b-8be9-a48573290e71 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:55.202922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-224da91e-2e29-4e2b-8be9-a48573290e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:55.227445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 518/1010] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:55.250617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f68a0-bad1-426f-80cd-713cc6c07813 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:55.257937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:55.288966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 493/1011] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:55 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:55.312362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224da91e-2e29-4e2b-8be9-a48573290e71 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:55.343190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:55.365926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f68a0-bad1-426f-80cd-713cc6c07813 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:55.402775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:55.403509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.403807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.404080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.404736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:55.406096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:55.416747 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224da91e-2e29-4e2b-8be9-a48573290e71 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:55.417460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:55.418517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:28:55.419373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 519/1012] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:55.424807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:55.458503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882b4b-b1a6-418d-84ac-cf5fae5a5806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:55.459463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882b4b-b1a6-418d-84ac-cf5fae5a5806 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.459786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882b4b-b1a6-418d-84ac-cf5fae5a5806 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.460064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c882b4b-b1a6-418d-84ac-cf5fae5a5806 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.461344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c882b4b-b1a6-418d-84ac-cf5fae5a5806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:55.462793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c882b4b-b1a6-418d-84ac-cf5fae5a5806 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:55.464928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 494/1013] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:55.470357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882b4b-b1a6-418d-84ac-cf5fae5a5806 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:55.522688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:55.534487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58ea50-3318-48be-9c02-dbeb1c7225fb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:55.570366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:55.571362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.571872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.572156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.572932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:55.573243 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:55.574656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:55.584088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c882b4b-b1a6-418d-84ac-cf5fae5a5806 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:55.584233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 520/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:55.585055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:55.598360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:55.617745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec964238-13b2-46b5-883b-613574ce3f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:55.618421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964238-13b2-46b5-883b-613574ce3f23 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.618700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964238-13b2-46b5-883b-613574ce3f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.618969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec964238-13b2-46b5-883b-613574ce3f23 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.619719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec964238-13b2-46b5-883b-613574ce3f23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:55.621234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec964238-13b2-46b5-883b-613574ce3f23 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:55.653282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 495/1015] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:28:55 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:28:55.713541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a80f5-623c-4797-ba11-3c7e6929637b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:55.751714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fc425-d883-4122-8595-cf21d8ec99a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:55.752405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc425-d883-4122-8595-cf21d8ec99a8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.752683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc425-d883-4122-8595-cf21d8ec99a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.752954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fc425-d883-4122-8595-cf21d8ec99a8 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.753681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fc425-d883-4122-8595-cf21d8ec99a8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:55.753984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fc425-d883-4122-8595-cf21d8ec99a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:55.755366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fc425-d883-4122-8595-cf21d8ec99a8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:55.766216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 521/1016] 10.222.0.64 () {56 vars in 1112 bytes} [Tue Jul 12 13:28:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:55.767487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec964238-13b2-46b5-883b-613574ce3f23 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:55.871273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:55.877664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec964238-13b2-46b5-883b-613574ce3f23 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:55.914199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec1132-cc69-4cdf-8428-894284c0f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:55.914825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1132-cc69-4cdf-8428-894284c0f8fd None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:55.915116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1132-cc69-4cdf-8428-894284c0f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:55.915394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec1132-cc69-4cdf-8428-894284c0f8fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:55.916175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec1132-cc69-4cdf-8428-894284c0f8fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:55.917558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec1132-cc69-4cdf-8428-894284c0f8fd None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:55.940711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 496/1017] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:28:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:28:56.604859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0f4ff-9238-41ad-b858-c39fa9f0d257 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:56.605468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0f4ff-9238-41ad-b858-c39fa9f0d257 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:56.605468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe0f4ff-9238-41ad-b858-c39fa9f0d257 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:56.607027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 522/1018] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:56.612269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3e679-a04f-4620-a9c8-57545fa6a52b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:56.613130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3e679-a04f-4620-a9c8-57545fa6a52b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:56.613620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3e679-a04f-4620-a9c8-57545fa6a52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:56.631569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-06d3e679-a04f-4620-a9c8-57545fa6a52b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:56.633079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-06d3e679-a04f-4620-a9c8-57545fa6a52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:56.724429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 497/1019] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:56.747900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0f4ff-9238-41ad-b858-c39fa9f0d257 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:56.828282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:56.856016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe0f4ff-9238-41ad-b858-c39fa9f0d257 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:56.889350 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7fa65f-4270-4805-95b4-30615100dce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:56.890024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fa65f-4270-4805-95b4-30615100dce0 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:56.890308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fa65f-4270-4805-95b4-30615100dce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:56.890584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7fa65f-4270-4805-95b4-30615100dce0 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:56.891320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fa65f-4270-4805-95b4-30615100dce0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:56.892723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7fa65f-4270-4805-95b4-30615100dce0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:56.911644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 523/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:28:56 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:28:57.732420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803efd3-7e7d-4cc7-81c4-f9ab1208f604 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:57.733029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803efd3-7e7d-4cc7-81c4-f9ab1208f604 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:57.733029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803efd3-7e7d-4cc7-81c4-f9ab1208f604 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:57.735641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 498/1021] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:28:57.739666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895c44-1dc3-4e32-9a8f-b28bb43a7035 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:57.740135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895c44-1dc3-4e32-9a8f-b28bb43a7035 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:57.740228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c895c44-1dc3-4e32-9a8f-b28bb43a7035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:57.757780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0c895c44-1dc3-4e32-9a8f-b28bb43a7035 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:57.758939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0c895c44-1dc3-4e32-9a8f-b28bb43a7035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:57.836789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 524/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:57.860920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803efd3-7e7d-4cc7-81c4-f9ab1208f604 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:57.966433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:57.989367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803efd3-7e7d-4cc7-81c4-f9ab1208f604 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:58.030222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c241c-8a31-4033-b913-a13511bd32f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:58.031041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c241c-8a31-4033-b913-a13511bd32f3 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.031320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c241c-8a31-4033-b913-a13511bd32f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.031577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c241c-8a31-4033-b913-a13511bd32f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.032805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c241c-8a31-4033-b913-a13511bd32f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:58.034341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9c241c-8a31-4033-b913-a13511bd32f3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:58.036204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 499/1023] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:58.041725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c895c44-1dc3-4e32-9a8f-b28bb43a7035 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:58.053693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa479-9d5c-4769-a4cd-e7aca7e2c4f9 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.054065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa479-9d5c-4769-a4cd-e7aca7e2c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.054233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93fa479-9d5c-4769-a4cd-e7aca7e2c4f9 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.060036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 500/1024] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:58.062217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e919f-215f-4eaf-8202-4fd157d92750 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.062507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e919f-215f-4eaf-8202-4fd157d92750 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.062777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e919f-215f-4eaf-8202-4fd157d92750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.080553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7c8e919f-215f-4eaf-8202-4fd157d92750 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:58.081745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7c8e919f-215f-4eaf-8202-4fd157d92750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:58.114421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:58.156598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 501/1025] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:28:58.163482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c895c44-1dc3-4e32-9a8f-b28bb43a7035 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:58.180143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e919f-215f-4eaf-8202-4fd157d92750 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:58.204058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88aa84-ba45-454f-80e2-f1d682d81c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:58.204805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88aa84-ba45-454f-80e2-f1d682d81c43 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.205092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88aa84-ba45-454f-80e2-f1d682d81c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.205372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88aa84-ba45-454f-80e2-f1d682d81c43 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.206111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88aa84-ba45-454f-80e2-f1d682d81c43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:58.207624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d88aa84-ba45-454f-80e2-f1d682d81c43 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:58.239718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 525/1026] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:28:58 2022] POST /identity/v3/users => generated 285 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:28:58.279025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:58.313202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e919f-215f-4eaf-8202-4fd157d92750 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:58.353218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea33ec-8d92-4fd9-b900-98d9ab601c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:58.354083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea33ec-8d92-4fd9-b900-98d9ab601c77 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.354336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea33ec-8d92-4fd9-b900-98d9ab601c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.354608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea33ec-8d92-4fd9-b900-98d9ab601c77 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.367310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea33ec-8d92-4fd9-b900-98d9ab601c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-76ea33ec-8d92-4fd9-b900-98d9ab601c77 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:28:58.375592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:58.376697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:58.377628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 502/1027] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 12 13:28:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:58.383141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88aa84-ba45-454f-80e2-f1d682d81c43 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:58.495713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d88aa84-ba45-454f-80e2-f1d682d81c43 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:58.515809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:58.537703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:58.538434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.538714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.538987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.539784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:58.540093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:58.541531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:58.556642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 526/1028] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 12 13:28:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:58.558826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea33ec-8d92-4fd9-b900-98d9ab601c77 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:58.680439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea33ec-8d92-4fd9-b900-98d9ab601c77 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:58.714452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:58.715333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.715623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.715907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.722940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:58.727692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:58.729402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:58.747157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:58.748549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:58.749463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:58.749463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:58.749463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:58.749463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:58.751674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 503/1029] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:58.754314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:58.857419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb4bcb-a368-4cc9-afd2-f3dca4d073df None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:58.892743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071cf94b-7ade-46e8-a66e-cc4bb04cd37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:58.893422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf94b-7ade-46e8-a66e-cc4bb04cd37e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.893706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf94b-7ade-46e8-a66e-cc4bb04cd37e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.893983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071cf94b-7ade-46e8-a66e-cc4bb04cd37e None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.894713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf94b-7ade-46e8-a66e-cc4bb04cd37e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:58.895023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf94b-7ade-46e8-a66e-cc4bb04cd37e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:58.896422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071cf94b-7ade-46e8-a66e-cc4bb04cd37e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:58.908893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 527/1030] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:58.914888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:58.978077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364a27b-fa5c-4195-ae1f-713d98d100c0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.978323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364a27b-fa5c-4195-ae1f-713d98d100c0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.978592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b364a27b-fa5c-4195-ae1f-713d98d100c0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:58.980203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 528/1031] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:28:58.984913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b36ef-81aa-438d-8c37-b82bd13a0904 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:58.985195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b36ef-81aa-438d-8c37-b82bd13a0904 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:58.985466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1b36ef-81aa-438d-8c37-b82bd13a0904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.002617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6c1b36ef-81aa-438d-8c37-b82bd13a0904 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:28:59.003750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6c1b36ef-81aa-438d-8c37-b82bd13a0904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:28:59.023408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6bcfc-b203-4998-b39f-bf07314b71aa None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.034517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:59.061203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.062436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.062721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.063152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.071847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.073306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.076766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 529/1032] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:28:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:28:59.087705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:59.088658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:59.089669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 504/1033] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:28:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:28:59.094671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b36ef-81aa-438d-8c37-b82bd13a0904 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.100752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.151828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:59.198234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1b36ef-81aa-438d-8c37-b82bd13a0904 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.204849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5f834-688a-47c9-aa26-384bc3002348 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.232092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.232767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.233051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.233310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.234145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:59.234452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.235893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.238823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.239342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.239647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.239925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] PATH_INFO: `/v3/services/image` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.240581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.241935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:59.254927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:59.261334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:59.262223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 505/1034] 10.222.0.64 () {56 vars in 1105 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:59.263041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 530/1035] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:59.263122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.263191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.293624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:59.370400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53f8b4-bdb2-4694-9494-d8c7adf2a8aa None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.373588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749caac-8e3b-4df9-bdc9-7ee5520edb00 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.388455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:59.410402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5be82-58b3-410e-93d9-7bd7b3ea8046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.410622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.411062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5be82-58b3-410e-93d9-7bd7b3ea8046 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.411179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.411338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.411437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5be82-58b3-410e-93d9-7bd7b3ea8046 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.411645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.411741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5be82-58b3-410e-93d9-7bd7b3ea8046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.412334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:59.412638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.414000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.425041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 531/1036] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:59.426383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.482174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5be82-58b3-410e-93d9-7bd7b3ea8046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.483669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5be82-58b3-410e-93d9-7bd7b3ea8046 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.530031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:59.539496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa00139f-658d-4602-b21d-158b0963b4d0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.576588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.577369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.577659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.577920 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.578627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] RBAC: Adding query filter params (type=image) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:59.578931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.580520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.590298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 532/1037] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:28:59.590479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 506/1038] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:28:59.592016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.593868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5be82-58b3-410e-93d9-7bd7b3ea8046 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.609553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:59.703814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5be82-58b3-410e-93d9-7bd7b3ea8046 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.704119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bc42f-c841-46c6-943d-32eb14520819 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.737324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.737991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.738272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.738544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.739332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] RBAC: Adding query filter params (interface=public, service_id=f7b25a0cdf1a4844b80b91ca990fa39a, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:59.739670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.740743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.741033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.741546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.741826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.742093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.746693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 533/1039] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/endpoints?service_id=f7b25a0cdf1a4844b80b91ca990fa39a&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:59.751984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.754803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.756270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.772421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:28:59.774222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:28:59.775104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:28:59.776030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:28:59.776030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:28:59.776030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:28:59.776030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:28:59.776030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 507/1040] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:28:59.781349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:28:59.851873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:28:59.861209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd305e0-ff7c-41ac-a95c-7d496cfb8ba6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.888606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32c2ea-8c2b-4fc9-9cf3-0cb8d2c2b070 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:28:59.896179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9546deb-ddf5-45e2-b66e-fe81e0879f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.896853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9546deb-ddf5-45e2-b66e-fe81e0879f51 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.897142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9546deb-ddf5-45e2-b66e-fe81e0879f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.897415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9546deb-ddf5-45e2-b66e-fe81e0879f51 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.898117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9546deb-ddf5-45e2-b66e-fe81e0879f51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.899471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9546deb-ddf5-45e2-b66e-fe81e0879f51 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.906152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 534/1041] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:28:59.939429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:28:59.940154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:28:59.940430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:28:59.940728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:28:59.941468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:28:59.941772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:28:59.943234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:28:59.957335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 508/1042] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:28:59.963088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9546deb-ddf5-45e2-b66e-fe81e0879f51 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:00.054895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:00.074419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9546deb-ddf5-45e2-b66e-fe81e0879f51 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:00.112471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:00.113285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:00.113560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:00.113832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:00.120736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:00.122234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:29:00.136529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:00.137462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:00.138773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 535/1043] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:00.143801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:00.245710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cbce58-51aa-47e8-8f65-1b045a25e35c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:00.272196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:00.282155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71381d-b497-4482-87dc-6796c48c0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:00.282906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71381d-b497-4482-87dc-6796c48c0d76 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:00.283244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71381d-b497-4482-87dc-6796c48c0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:00.283570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71381d-b497-4482-87dc-6796c48c0d76 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:00.284460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71381d-b497-4482-87dc-6796c48c0d76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:00.284831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71381d-b497-4482-87dc-6796c48c0d76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:00.286305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71381d-b497-4482-87dc-6796c48c0d76 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:00.299159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 509/1044] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:29:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:00.304997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:00.372499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972561a-75fc-4e01-bb5e-1f9564ff2517 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:00.372840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972561a-75fc-4e01-bb5e-1f9564ff2517 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:00.373044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972561a-75fc-4e01-bb5e-1f9564ff2517 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:00.374424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 510/1045] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:00.379311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755997c9-63ce-432c-ae94-c121d5ddf87b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:00.379630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755997c9-63ce-432c-ae94-c121d5ddf87b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:00.379940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755997c9-63ce-432c-ae94-c121d5ddf87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:00.399113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-755997c9-63ce-432c-ae94-c121d5ddf87b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:00.400361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-755997c9-63ce-432c-ae94-c121d5ddf87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:00.416685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e809d-a396-4ffa-8cda-9b0bbeb90552 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:00.452747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:00.453415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:00.453696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:00.453978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:00.454949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] RBAC: Adding query filter params (role.id=e772014e2905402e827af855e6bcd2b5, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=6eb064e8062d4a4eb7a7974f7200c86f) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:00.455259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:00.456731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:00.471634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 536/1046] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:00 2022] GET /identity/v3/role_assignments?user.id=6eb064e8062d4a4eb7a7974f7200c86f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=e772014e2905402e827af855e6bcd2b5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:00.477013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 511/1047] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:29:00.501331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:00.510807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:00.613125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c1356-6ede-409a-a56e-345d165f555c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:00.658931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ab88f-cfd1-44d7-a8b8-776eae0304a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:00.659904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab88f-cfd1-44d7-a8b8-776eae0304a2 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:00.660281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab88f-cfd1-44d7-a8b8-776eae0304a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:00.660650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ab88f-cfd1-44d7-a8b8-776eae0304a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:00.671131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ab88f-cfd1-44d7-a8b8-776eae0304a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9a1ab88f-cfd1-44d7-a8b8-776eae0304a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:00.678891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:00.680098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:00.681170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:00.687841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 537/1048] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:00.692708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755997c9-63ce-432c-ae94-c121d5ddf87b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:00.809010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755997c9-63ce-432c-ae94-c121d5ddf87b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:00.826643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:00.845847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:00.846588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:00.846873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:00.847143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:00.847963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:00.848275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:00.849654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:00.862539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 512/1049] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:00.863925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ab88f-cfd1-44d7-a8b8-776eae0304a2 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:00.929400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:00.967248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ab88f-cfd1-44d7-a8b8-776eae0304a2 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:01.001350 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611593f5-06c5-4113-8654-a02ebd6bd26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:01.002236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611593f5-06c5-4113-8654-a02ebd6bd26a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:01.002502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611593f5-06c5-4113-8654-a02ebd6bd26a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:01.002791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611593f5-06c5-4113-8654-a02ebd6bd26a None admin] PATH_INFO: `/v3/users/0e155808056d4470a1617357f6bdde43` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:01.016751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611593f5-06c5-4113-8654-a02ebd6bd26a None admin] RBAC: Authorizing `identity:get_user(user_id=0e155808056d4470a1617357f6bdde43)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:01.018289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611593f5-06c5-4113-8654-a02ebd6bd26a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:01.023643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 538/1050] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:00 2022] GET /identity/v3/users/0e155808056d4470a1617357f6bdde43 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:01.025665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:01.136878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128afdeb-462e-4c5e-8ed3-01c8ab4a9434 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:01.171742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f591c57-255d-43eb-a746-bc7994949939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:01.172411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f591c57-255d-43eb-a746-bc7994949939 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:01.172691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f591c57-255d-43eb-a746-bc7994949939 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:01.172964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f591c57-255d-43eb-a746-bc7994949939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:01.219342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:01.243291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f591c57-255d-43eb-a746-bc7994949939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:01.244808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f591c57-255d-43eb-a746-bc7994949939 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:01.349427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 513/1051] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:01.355631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611593f5-06c5-4113-8654-a02ebd6bd26a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:01.456514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611593f5-06c5-4113-8654-a02ebd6bd26a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:01.481025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:01.492958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed6412-e4dd-4f06-adc3-f8f5318c84fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:01.493969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6412-e4dd-4f06-adc3-f8f5318c84fe None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:01.494348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6412-e4dd-4f06-adc3-f8f5318c84fe None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:01.494713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed6412-e4dd-4f06-adc3-f8f5318c84fe None admin] PATH_INFO: `/v3/projects/e224d804a11244b4a486cd18cfd6aca4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:01.496109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed6412-e4dd-4f06-adc3-f8f5318c84fe None admin] RBAC: Authorizing `identity:get_project(project_id=e224d804a11244b4a486cd18cfd6aca4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:01.497629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed6412-e4dd-4f06-adc3-f8f5318c84fe None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:01.503665 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 539/1052] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:01 2022] GET /identity/v3/projects/e224d804a11244b4a486cd18cfd6aca4 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:01.505829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f591c57-255d-43eb-a746-bc7994949939 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:01.590486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:01.615047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f591c57-255d-43eb-a746-bc7994949939 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:01.651862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731a14c-205f-4cc4-80b9-b37300c0b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:01.652865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a14c-205f-4cc4-80b9-b37300c0b195 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:01.653294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a14c-205f-4cc4-80b9-b37300c0b195 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:01.653713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731a14c-205f-4cc4-80b9-b37300c0b195 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:01.654690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a14c-205f-4cc4-80b9-b37300c0b195 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=e224d804a11244b4a486cd18cfd6aca4, user.id=0e155808056d4470a1617357f6bdde43) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:01.655165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a14c-205f-4cc4-80b9-b37300c0b195 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:01.656780 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e731a14c-205f-4cc4-80b9-b37300c0b195 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:01.671630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 514/1053] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:01 2022] GET /identity/v3/role_assignments?user.id=0e155808056d4470a1617357f6bdde43&scope.project.id=e224d804a11244b4a486cd18cfd6aca4&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:02.004252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e24e2-fc78-4f39-bcc8-d1486d26392d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.005090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e24e2-fc78-4f39-bcc8-d1486d26392d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.005090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e24e2-fc78-4f39-bcc8-d1486d26392d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.006389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 540/1054] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:02.012426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c658110-91c4-436d-970d-3c1519ce9814 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.012853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c658110-91c4-436d-970d-3c1519ce9814 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.013014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c658110-91c4-436d-970d-3c1519ce9814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.030851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3c658110-91c4-436d-970d-3c1519ce9814 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:02.032163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3c658110-91c4-436d-970d-3c1519ce9814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:02.102863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 515/1055] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:02.125825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e24e2-fc78-4f39-bcc8-d1486d26392d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:02.254971 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e24e2-fc78-4f39-bcc8-d1486d26392d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:02.293877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:02.294680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.294957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.295229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] PATH_INFO: `/v3/services/image` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.295925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:02.297291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:02.309231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:02.310618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:02.311588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 541/1056] 10.222.0.64 () {56 vars in 1105 bytes} [Tue Jul 12 13:29:02 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:02.317906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c658110-91c4-436d-970d-3c1519ce9814 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:02.400355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:02.434191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c658110-91c4-436d-970d-3c1519ce9814 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:02.468306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be289b24-d99a-4361-8b5b-23cbf3880442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:02.468986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289b24-d99a-4361-8b5b-23cbf3880442 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.469274 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289b24-d99a-4361-8b5b-23cbf3880442 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.469563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be289b24-d99a-4361-8b5b-23cbf3880442 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.470282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be289b24-d99a-4361-8b5b-23cbf3880442 None admin] RBAC: Adding query filter params (name=image) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:02.470591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be289b24-d99a-4361-8b5b-23cbf3880442 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:02.472045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be289b24-d99a-4361-8b5b-23cbf3880442 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:02.477447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 516/1057] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:02.483305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:02.505438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d4b3-1997-4bc4-ba7d-2219fab49254 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.505693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d4b3-1997-4bc4-ba7d-2219fab49254 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.505914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10d4b3-1997-4bc4-ba7d-2219fab49254 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.507292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 517/1058] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:29:02.512137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd7a4-8b44-42af-8d4d-1d2b7d8d976d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.512427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd7a4-8b44-42af-8d4d-1d2b7d8d976d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.512682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0cd7a4-8b44-42af-8d4d-1d2b7d8d976d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.528920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7f0cd7a4-8b44-42af-8d4d-1d2b7d8d976d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:02.530104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7f0cd7a4-8b44-42af-8d4d-1d2b7d8d976d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:02.544622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:02.588756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb738e0-7d7f-47a7-aadf-8c3ecbd66aae None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:02.596726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 518/1059] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:29:02.618839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cd7a4-8b44-42af-8d4d-1d2b7d8d976d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:02.622332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:02.622998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.623279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.623554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.624298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] RBAC: Adding query filter params (type=image) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:02.624607 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:02.625976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:02.631195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 542/1060] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:02.637293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:02.698678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:02.735667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0cd7a4-8b44-42af-8d4d-1d2b7d8d976d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:02.744192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae7f70-75c9-4f3e-b613-fe36d605d487 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:02.765667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:02.773735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372522d-a344-4797-bebe-58dbffd50699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:02.774586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372522d-a344-4797-bebe-58dbffd50699 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.774883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372522d-a344-4797-bebe-58dbffd50699 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.775158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9372522d-a344-4797-bebe-58dbffd50699 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.781824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08944a-d6ca-4cc8-ab96-c831064acdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:02.782685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08944a-d6ca-4cc8-ab96-c831064acdfb None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.783273 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08944a-d6ca-4cc8-ab96-c831064acdfb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.783555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08944a-d6ca-4cc8-ab96-c831064acdfb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.784369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08944a-d6ca-4cc8-ab96-c831064acdfb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:02.785906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9372522d-a344-4797-bebe-58dbffd50699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:02.786099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08944a-d6ca-4cc8-ab96-c831064acdfb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-9372522d-a344-4797-bebe-58dbffd50699 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:02.795829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:02.796902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:02.797851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 519/1061] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 12 13:29:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:02.803939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372522d-a344-4797-bebe-58dbffd50699 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:02.815306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 543/1062] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:29:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:29:02.928532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9372522d-a344-4797-bebe-58dbffd50699 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:02.956490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:02.974243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:02.974935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:02.975219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:02.975494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:02.976290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:02.976608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:02.977982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:02.987045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 520/1063] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 12 13:29:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:02.992689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08944a-d6ca-4cc8-ab96-c831064acdfb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:03.098405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08944a-d6ca-4cc8-ab96-c831064acdfb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:03.133347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:03.134157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:03.134439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:03.134711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:03.145701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:03.147150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:29:03.164450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:03.165384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:03.166313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:29:03.166313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:29:03.166313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:03.166313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:03.166313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 544/1064] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:03.172595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:03.282287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d762393-a7cc-4110-ba74-42edb3998b23 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:03.321005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:03.321684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:03.321970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:03.322244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:03.322976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:03.323290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:03.324899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:03.338498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 521/1065] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:03.344720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:03.384223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:03.464493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb24b87-b414-4a89-b3e2-f2cee5dc83b6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:03.498136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:03.498945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:03.499229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:03.499503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:03.507141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:03.508610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:29:03.522308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:03.523249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:03.528955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 545/1066] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:29:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:29:03.531536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:03.580440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:03.636765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d81ed1-6f41-4662-8f8f-2b9ccfe3c13d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:03.680062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1d7ef-727c-4a18-931d-8f982a78d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:03.680788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d7ef-727c-4a18-931d-8f982a78d889 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:03.681074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d7ef-727c-4a18-931d-8f982a78d889 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:03.681351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1d7ef-727c-4a18-931d-8f982a78d889 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:03.682173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1d7ef-727c-4a18-931d-8f982a78d889 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:03.682485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1d7ef-727c-4a18-931d-8f982a78d889 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:03.684020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1d7ef-727c-4a18-931d-8f982a78d889 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:03.701789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 522/1067] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:29:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:03.707464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:03.713669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64eca1-c0bb-457f-b379-49f23cad3d2d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:03.713992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64eca1-c0bb-457f-b379-49f23cad3d2d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:03.714269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e64eca1-c0bb-457f-b379-49f23cad3d2d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:03.715924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 523/1068] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:29:03.720710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720996cc-afd5-45cc-bccc-9720736244bc None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:03.720994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720996cc-afd5-45cc-bccc-9720736244bc None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:03.721266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720996cc-afd5-45cc-bccc-9720736244bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:03.737175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-720996cc-afd5-45cc-bccc-9720736244bc None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:03.738360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-720996cc-afd5-45cc-bccc-9720736244bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:03.797798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:03.808665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 524/1069] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:29:03.811504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e96514-589f-4de6-bf93-2c03f8a4daa7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:03.830815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720996cc-afd5-45cc-bccc-9720736244bc None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:03.847050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:03.847979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:03.848262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:03.848534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:03.859991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:03.861513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:03.861617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:29:03.879158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:03.880172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:03.881055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:29:03.881055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:29:03.881055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:03.881055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:03.881055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 546/1070] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:03.886630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:03.939834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720996cc-afd5-45cc-bccc-9720736244bc None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:03.978014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7df3d-32be-4547-9a1d-e770026b1580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:03.978936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7df3d-32be-4547-9a1d-e770026b1580 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:03.979217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7df3d-32be-4547-9a1d-e770026b1580 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:03.979486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7df3d-32be-4547-9a1d-e770026b1580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:03.990765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c26e5-fef5-4f6a-8190-56d11841aa31 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:03.991003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7df3d-32be-4547-9a1d-e770026b1580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-58f7df3d-32be-4547-9a1d-e770026b1580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:03.999173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:04.000141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:04.001236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 525/1071] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:29:04.006494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7df3d-32be-4547-9a1d-e770026b1580 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:04.034197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374441-8100-4132-80bf-e660399902d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:04.034996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374441-8100-4132-80bf-e660399902d6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.035282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374441-8100-4132-80bf-e660399902d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.035559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03374441-8100-4132-80bf-e660399902d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.036350 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374441-8100-4132-80bf-e660399902d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:04.036663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374441-8100-4132-80bf-e660399902d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:04.038037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03374441-8100-4132-80bf-e660399902d6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:04.047033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:04.051912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 547/1072] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:04.056492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374441-8100-4132-80bf-e660399902d6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:04.106594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:04.116641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7df3d-32be-4547-9a1d-e770026b1580 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:04.149573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:04.150264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.150547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.150809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.151572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:04.151907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:04.153321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:04.158482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03374441-8100-4132-80bf-e660399902d6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:04.161263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 526/1073] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:04.167076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:04.198440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:04.199231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.199570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.199882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.206617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:04.208085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:29:04.221536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:04.222419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:04.223310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 548/1074] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:29:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:29:04.228488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:04.276121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bf2bd-cc46-4867-b15d-4dc6c7f18aaa None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:04.293107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:04.311320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352393c-3058-4817-8f11-ab2d2ce9d7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:04.312250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352393c-3058-4817-8f11-ab2d2ce9d7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.312528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352393c-3058-4817-8f11-ab2d2ce9d7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.312799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352393c-3058-4817-8f11-ab2d2ce9d7a8 None admin] PATH_INFO: `/v3/users/0e155808056d4470a1617357f6bdde43` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.313997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352393c-3058-4817-8f11-ab2d2ce9d7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=0e155808056d4470a1617357f6bdde43)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:04.315442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7352393c-3058-4817-8f11-ab2d2ce9d7a8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:04.317155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 527/1075] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:04 2022] GET /identity/v3/users/0e155808056d4470a1617357f6bdde43 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:04.322986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352393c-3058-4817-8f11-ab2d2ce9d7a8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:04.338208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0883-85a3-4731-a82d-786a1b075c81 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:04.348559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:04.377982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62f298-66df-4061-9896-18730a14379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:04.379091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62f298-66df-4061-9896-18730a14379f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.379377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62f298-66df-4061-9896-18730a14379f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.379940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62f298-66df-4061-9896-18730a14379f None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.380741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62f298-66df-4061-9896-18730a14379f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:04.381208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62f298-66df-4061-9896-18730a14379f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:04.383250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62f298-66df-4061-9896-18730a14379f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:04.397193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 549/1076] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:29:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:04.403656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62f298-66df-4061-9896-18730a14379f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:04.429787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352393c-3058-4817-8f11-ab2d2ce9d7a8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:04.466445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10f082-f148-47b2-887e-41c4f0540f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:04.467242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f082-f148-47b2-887e-41c4f0540f47 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.467517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f082-f148-47b2-887e-41c4f0540f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.467834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10f082-f148-47b2-887e-41c4f0540f47 None admin] PATH_INFO: `/v3/projects/e224d804a11244b4a486cd18cfd6aca4` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.469003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f082-f148-47b2-887e-41c4f0540f47 None admin] RBAC: Authorizing `identity:get_project(project_id=e224d804a11244b4a486cd18cfd6aca4)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:04.470450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10f082-f148-47b2-887e-41c4f0540f47 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:04.472207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 528/1077] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:04 2022] GET /identity/v3/projects/e224d804a11244b4a486cd18cfd6aca4 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:04.477987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10f082-f148-47b2-887e-41c4f0540f47 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:04.510511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62f298-66df-4061-9896-18730a14379f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:04.532472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:04.547684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce633f4c-745d-4796-b9cb-6c22330449a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:04.548591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce633f4c-745d-4796-b9cb-6c22330449a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.548871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce633f4c-745d-4796-b9cb-6c22330449a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.549149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce633f4c-745d-4796-b9cb-6c22330449a3 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/6eb064e8062d4a4eb7a7974f7200c86f/roles/e772014e2905402e827af855e6bcd2b5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.551391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce633f4c-745d-4796-b9cb-6c22330449a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=6eb064e8062d4a4eb7a7974f7200c86f, role_id=e772014e2905402e827af855e6bcd2b5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:04.552853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce633f4c-745d-4796-b9cb-6c22330449a3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:04.567290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 550/1078] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:29:04 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/6eb064e8062d4a4eb7a7974f7200c86f/roles/e772014e2905402e827af855e6bcd2b5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:29:04.578776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:04.590697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10f082-f148-47b2-887e-41c4f0540f47 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:04.629792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9b614-4e85-4c9a-9fd7-d606f3d59767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:04.630703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b614-4e85-4c9a-9fd7-d606f3d59767 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.630948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b614-4e85-4c9a-9fd7-d606f3d59767 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.631239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9b614-4e85-4c9a-9fd7-d606f3d59767 None admin] PATH_INFO: `/v3/projects/e224d804a11244b4a486cd18cfd6aca4/users/0e155808056d4470a1617357f6bdde43/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.633504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9b614-4e85-4c9a-9fd7-d606f3d59767 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224d804a11244b4a486cd18cfd6aca4, user_id=0e155808056d4470a1617357f6bdde43, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:04.635032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9b614-4e85-4c9a-9fd7-d606f3d59767 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:04.659697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 529/1079] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:29:04 2022] PUT /identity/v3/projects/e224d804a11244b4a486cd18cfd6aca4/users/0e155808056d4470a1617357f6bdde43/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:29:04.866741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34561-09b2-43f1-964d-6e10df086ffd None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.867014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34561-09b2-43f1-964d-6e10df086ffd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.867315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34561-09b2-43f1-964d-6e10df086ffd None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.868901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 551/1080] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:04.873996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2e50e-c283-4f13-b418-1dcadab2ad9c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:04.874318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2e50e-c283-4f13-b418-1dcadab2ad9c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:04.874601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2e50e-c283-4f13-b418-1dcadab2ad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:04.892265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-98b2e50e-c283-4f13-b418-1dcadab2ad9c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:04.893466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-98b2e50e-c283-4f13-b418-1dcadab2ad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:04.965664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 530/1081] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:04.987817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34561-09b2-43f1-964d-6e10df086ffd None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:05.091331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34561-09b2-43f1-964d-6e10df086ffd None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:05.125683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1c6fe-3438-47ca-938b-70e572e20552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:05.126265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1c6fe-3438-47ca-938b-70e572e20552 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:05.126604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1c6fe-3438-47ca-938b-70e572e20552 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:05.126882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1c6fe-3438-47ca-938b-70e572e20552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:05.174333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:05.196689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1c6fe-3438-47ca-938b-70e572e20552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:05.198162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1c6fe-3438-47ca-938b-70e572e20552 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:05.298532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 552/1082] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:05.304388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2e50e-c283-4f13-b418-1dcadab2ad9c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:05.390881 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:05.413566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2e50e-c283-4f13-b418-1dcadab2ad9c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:05.448082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27e19b-2669-4e29-b142-1d9a1f1d2edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:05.448891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27e19b-2669-4e29-b142-1d9a1f1d2edf None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:05.449195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27e19b-2669-4e29-b142-1d9a1f1d2edf None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:05.449472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27e19b-2669-4e29-b142-1d9a1f1d2edf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:05.459482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27e19b-2669-4e29-b142-1d9a1f1d2edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:05.460983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27e19b-2669-4e29-b142-1d9a1f1d2edf None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ef27e19b-2669-4e29-b142-1d9a1f1d2edf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:29:05.478305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:05.479193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:05.485304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:29:05.485304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:29:05.485304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:05.485304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:05.485304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 531/1083] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:05.485645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1c6fe-3438-47ca-938b-70e572e20552 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:05.565357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:05.585671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1c6fe-3438-47ca-938b-70e572e20552 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:05.619614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406cf0f-a8d9-45a7-b12a-6bd6918eafac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:05.620290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cf0f-a8d9-45a7-b12a-6bd6918eafac None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:05.620578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cf0f-a8d9-45a7-b12a-6bd6918eafac None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:05.620880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406cf0f-a8d9-45a7-b12a-6bd6918eafac None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:05.621612 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406cf0f-a8d9-45a7-b12a-6bd6918eafac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:05.621918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406cf0f-a8d9-45a7-b12a-6bd6918eafac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:05.623280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406cf0f-a8d9-45a7-b12a-6bd6918eafac None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:05.635104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 553/1084] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:06.598168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af31f5-e9b7-4bba-af07-ddf57bb8b5da None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:06.598730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af31f5-e9b7-4bba-af07-ddf57bb8b5da None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:06.598730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af31f5-e9b7-4bba-af07-ddf57bb8b5da None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:06.600138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 532/1085] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:06.605396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a61a5-d24d-4a99-882e-82c726d0ecf2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:06.605835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a61a5-d24d-4a99-882e-82c726d0ecf2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:06.605947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a61a5-d24d-4a99-882e-82c726d0ecf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:06.623283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-be7a61a5-d24d-4a99-882e-82c726d0ecf2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:06.624488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-be7a61a5-d24d-4a99-882e-82c726d0ecf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:06.693865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 554/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:06.704769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303459e7-7814-4074-8d50-ce460a27b239 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:06.705153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303459e7-7814-4074-8d50-ce460a27b239 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:06.705555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303459e7-7814-4074-8d50-ce460a27b239 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:06.707758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 533/1087] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:06.715814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5a08-28a2-40b6-b127-2bd7b7b5ace7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:06.716106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5a08-28a2-40b6-b127-2bd7b7b5ace7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:06.716383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a5a08-28a2-40b6-b127-2bd7b7b5ace7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:06.721480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303459e7-7814-4074-8d50-ce460a27b239 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:06.733848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-313a5a08-28a2-40b6-b127-2bd7b7b5ace7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:06.734737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-313a5a08-28a2-40b6-b127-2bd7b7b5ace7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:06.807028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:06.813722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 555/1088] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:06.835732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303459e7-7814-4074-8d50-ce460a27b239 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:06.837305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a5a08-28a2-40b6-b127-2bd7b7b5ace7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:06.868903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:06.875897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804d19-4689-4108-ad4a-4be0512a7f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:06.876717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804d19-4689-4108-ad4a-4be0512a7f90 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:06.876995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804d19-4689-4108-ad4a-4be0512a7f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:06.877268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74804d19-4689-4108-ad4a-4be0512a7f90 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:06.888779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74804d19-4689-4108-ad4a-4be0512a7f90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-74804d19-4689-4108-ad4a-4be0512a7f90 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:06.896963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:06.897977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:06.898838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 534/1089] 10.222.0.64 () {56 vars in 1120 bytes} [Tue Jul 12 13:29:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:29:06.904304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804d19-4689-4108-ad4a-4be0512a7f90 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:06.945666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a5a08-28a2-40b6-b127-2bd7b7b5ace7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:06.980558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382dfc-44fd-41d1-b6f0-fe71d71992f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:06.981436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382dfc-44fd-41d1-b6f0-fe71d71992f3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:06.981753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382dfc-44fd-41d1-b6f0-fe71d71992f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:06.982094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382dfc-44fd-41d1-b6f0-fe71d71992f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:06.994606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68382dfc-44fd-41d1-b6f0-fe71d71992f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-68382dfc-44fd-41d1-b6f0-fe71d71992f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:07.003718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:07.004727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:07.005745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 556/1090] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:29:07.009473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74804d19-4689-4108-ad4a-4be0512a7f90 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.011459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382dfc-44fd-41d1-b6f0-fe71d71992f3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.056047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.056887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.057257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.057605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.058678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:07.058996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.060869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.074646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 535/1091] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 12 13:29:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:07.075685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.092582 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:07.132689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:07.133816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382dfc-44fd-41d1-b6f0-fe71d71992f3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.167173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.167932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.168216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.168489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.169288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:07.169597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.170978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.177892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a5ceaa-3676-44c4-a33b-27001cf12d96 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.179006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 557/1092] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:07.184647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.212707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.213470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.213750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.214028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.224840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.226346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:29:07.243319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:07.244226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:07.245149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:29:07.245149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:29:07.245149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:07.245149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:07.245149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 536/1093] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:29:07.250362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.286412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e19eaf-8344-4b4c-bfd9-7fb06e8bd09d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.308729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:07.321177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abb6ea-bb20-414d-ab9a-621e54bd8557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.322053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb6ea-bb20-414d-ab9a-621e54bd8557 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.322333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb6ea-bb20-414d-ab9a-621e54bd8557 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.322605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abb6ea-bb20-414d-ab9a-621e54bd8557 None admin] PATH_INFO: `/v3/users/0e155808056d4470a1617357f6bdde43` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.323847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abb6ea-bb20-414d-ab9a-621e54bd8557 None admin] RBAC: Authorizing `identity:get_user(user_id=0e155808056d4470a1617357f6bdde43)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.325339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abb6ea-bb20-414d-ab9a-621e54bd8557 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.331579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 558/1094] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/users/0e155808056d4470a1617357f6bdde43 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:07.332555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abb6ea-bb20-414d-ab9a-621e54bd8557 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.348740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9986fef-42d6-4a85-8904-39735377f8f3 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.356553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:07.389699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.390261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.390556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.390822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.391534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:07.391869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.393221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.404347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 537/1095] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:07.409906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.432727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abb6ea-bb20-414d-ab9a-621e54bd8557 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.466512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42251424-71a5-4163-8e79-81784acf37f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.467160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42251424-71a5-4163-8e79-81784acf37f7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.467436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42251424-71a5-4163-8e79-81784acf37f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.467744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42251424-71a5-4163-8e79-81784acf37f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.509870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c718e42-9d00-465a-932b-c4e7981800af None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.523092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:07.534792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42251424-71a5-4163-8e79-81784acf37f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.536389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42251424-71a5-4163-8e79-81784acf37f7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.544631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.545496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.545772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.546040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.554652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.556192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:29:07.570269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:07.571178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:07.572281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 538/1096] 10.222.0.64 () {56 vars in 1093 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:29:07.577225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.603158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:07.633992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 559/1097] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:07.639996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42251424-71a5-4163-8e79-81784acf37f7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.677890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079ee65-9f95-42ab-b0a2-68988b44dae3 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.710855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.711521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.711827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.712098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.712924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:07.713229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.714775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.730777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:07.733372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 539/1098] 10.222.0.64 () {56 vars in 1133 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:07.739111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.740642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42251424-71a5-4163-8e79-81784acf37f7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.775221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3a854-4351-4e9c-a05c-c3406279f3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.776117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3a854-4351-4e9c-a05c-c3406279f3af None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.776395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3a854-4351-4e9c-a05c-c3406279f3af None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.776666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3a854-4351-4e9c-a05c-c3406279f3af None admin] PATH_INFO: `/v3/projects/e224d804a11244b4a486cd18cfd6aca4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.777923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3a854-4351-4e9c-a05c-c3406279f3af None admin] RBAC: Authorizing `identity:get_project(project_id=e224d804a11244b4a486cd18cfd6aca4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.779338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3a854-4351-4e9c-a05c-c3406279f3af None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.781098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 560/1099] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/projects/e224d804a11244b4a486cd18cfd6aca4 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:07.786919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3a854-4351-4e9c-a05c-c3406279f3af None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:07.821029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:07.836910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6838e-32be-4b26-b46c-4d6426e07fdc None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.871217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09a608-0a38-41f8-a51d-6ae3bb9784ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.871927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a608-0a38-41f8-a51d-6ae3bb9784ca None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.872204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a608-0a38-41f8-a51d-6ae3bb9784ca None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.872471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09a608-0a38-41f8-a51d-6ae3bb9784ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.881745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3a854-4351-4e9c-a05c-c3406279f3af None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:07.914203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:07.914777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:07.915053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:07.915325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:07.916186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=e224d804a11244b4a486cd18cfd6aca4, user.id=0e155808056d4470a1617357f6bdde43) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:07.916492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.917985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:07.923825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 561/1100] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/role_assignments?user.id=0e155808056d4470a1617357f6bdde43&scope.project.id=e224d804a11244b4a486cd18cfd6aca4&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:07.941245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09a608-0a38-41f8-a51d-6ae3bb9784ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:07.942729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09a608-0a38-41f8-a51d-6ae3bb9784ca None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:08.038802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:08.057143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 540/1101] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:08.063632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:08.089783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:08.166325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7664bd-5601-4343-9afb-00e18517d9eb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:08.200973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:08.201803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:08.202087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:08.202355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:08.213391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:08.214926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:29:08.233514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:08.234822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:08.235934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:29:08.235934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:29:08.235934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:29:08.235934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:08.235934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 562/1102] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:08.240549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09a608-0a38-41f8-a51d-6ae3bb9784ca None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:08.340949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09a608-0a38-41f8-a51d-6ae3bb9784ca None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:08.376200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:08.376875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:08.377152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:08.377422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:08.378139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:08.378439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:08.379861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:08.391517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 541/1103] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:29:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:08.397579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:08.476314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:08.502484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735beaf2-5fb4-491b-8c31-d715250d13b7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:08.536706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:08.537590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:08.537866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:08.538132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:08.545064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:08.546576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:29:08.561192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:08.562179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:08.563436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:29:08.563436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:29:08.563436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:29:08.563436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:29:08.563436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:29:08.563436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:29:08.563436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:29:08.563436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:08.567308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 563/1104] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:29:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:08.568331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:08.614685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:08.673201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1153412-8cc7-4a88-9bef-7b25996beba8 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:08.708255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b2990-b9c8-4dec-a92e-2131aa780947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:08.708917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b2990-b9c8-4dec-a92e-2131aa780947 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:08.709190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b2990-b9c8-4dec-a92e-2131aa780947 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:08.709432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b2990-b9c8-4dec-a92e-2131aa780947 None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:08.710237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b2990-b9c8-4dec-a92e-2131aa780947 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:08.710543 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b2990-b9c8-4dec-a92e-2131aa780947 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:08.712037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b2990-b9c8-4dec-a92e-2131aa780947 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:08.724339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 542/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:08.730867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:08.833178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4838f-57eb-4da2-8e9a-f3a92a18b014 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:08.866355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ba643-3138-4279-8165-aad20a242b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:08.867029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba643-3138-4279-8165-aad20a242b57 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:08.867326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba643-3138-4279-8165-aad20a242b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:08.867579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ba643-3138-4279-8165-aad20a242b57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:08.868480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ba643-3138-4279-8165-aad20a242b57 None admin] RBAC: Adding query filter params (role.id=e772014e2905402e827af855e6bcd2b5, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=6eb064e8062d4a4eb7a7974f7200c86f) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:08.868783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ba643-3138-4279-8165-aad20a242b57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:08.870288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ba643-3138-4279-8165-aad20a242b57 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:08.872192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:08.887636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 564/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:08 2022] GET /identity/v3/role_assignments?user.id=6eb064e8062d4a4eb7a7974f7200c86f&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=e772014e2905402e827af855e6bcd2b5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:09.997924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f9678-bf1b-4ce0-ad07-9b8e0626980f None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:09.998434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f9678-bf1b-4ce0-ad07-9b8e0626980f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:09.998434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f9678-bf1b-4ce0-ad07-9b8e0626980f None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:09.999885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 543/1107] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:10.005144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9f54-a4da-4116-910e-90dcf6f32ce5 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:10.005563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9f54-a4da-4116-910e-90dcf6f32ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:10.005696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed9f54-a4da-4116-910e-90dcf6f32ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:10.022415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-03ed9f54-a4da-4116-910e-90dcf6f32ce5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:10.023588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-03ed9f54-a4da-4116-910e-90dcf6f32ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:10.095636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 565/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:10.112850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f9678-bf1b-4ce0-ad07-9b8e0626980f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:10.218208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f9678-bf1b-4ce0-ad07-9b8e0626980f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:10.220597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:10.258712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9fe1f1-d511-45b6-ac43-1ff1522e905c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:10.259467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fe1f1-d511-45b6-ac43-1ff1522e905c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:10.259783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fe1f1-d511-45b6-ac43-1ff1522e905c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:10.260088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9fe1f1-d511-45b6-ac43-1ff1522e905c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:10.261343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fe1f1-d511-45b6-ac43-1ff1522e905c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:10.262858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9fe1f1-d511-45b6-ac43-1ff1522e905c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:10.264538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 544/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:10.273288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9f54-a4da-4116-910e-90dcf6f32ce5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:10.377510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed9f54-a4da-4116-910e-90dcf6f32ce5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:10.404584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:10.413075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f62bf1-a8a3-49d2-81e3-b96b27800e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:10.413752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62bf1-a8a3-49d2-81e3-b96b27800e75 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:10.414031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62bf1-a8a3-49d2-81e3-b96b27800e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:10.414303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f62bf1-a8a3-49d2-81e3-b96b27800e75 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:10.415020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f62bf1-a8a3-49d2-81e3-b96b27800e75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:10.416495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f62bf1-a8a3-49d2-81e3-b96b27800e75 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:10.437662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 566/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:29:10 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:29:12.512868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1c244-ef6f-4261-b4ce-6e2b257e8b0d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:12.513794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1c244-ef6f-4261-b4ce-6e2b257e8b0d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:12.513794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1c244-ef6f-4261-b4ce-6e2b257e8b0d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:12.516102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 545/1111] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:12.525303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fede8-bff9-4238-9d34-dd0844a3d79d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:12.526047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fede8-bff9-4238-9d34-dd0844a3d79d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:12.526200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fede8-bff9-4238-9d34-dd0844a3d79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:12.550674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-000fede8-bff9-4238-9d34-dd0844a3d79d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:12.551891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-000fede8-bff9-4238-9d34-dd0844a3d79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:12.621183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 567/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:12.644886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1c244-ef6f-4261-b4ce-6e2b257e8b0d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:12.756848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1c244-ef6f-4261-b4ce-6e2b257e8b0d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:12.794325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae06ee4-1d9e-4c17-9284-ddd0bf4e5d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:12.795123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae06ee4-1d9e-4c17-9284-ddd0bf4e5d0e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:12.795404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae06ee4-1d9e-4c17-9284-ddd0bf4e5d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:12.795702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae06ee4-1d9e-4c17-9284-ddd0bf4e5d0e None admin] PATH_INFO: `/v3/roles/f473c53d5223450d931d5e666473c86b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:12.797248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae06ee4-1d9e-4c17-9284-ddd0bf4e5d0e None admin] RBAC: Authorizing `identity:get_role(role_id=f473c53d5223450d931d5e666473c86b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:12.798619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae06ee4-1d9e-4c17-9284-ddd0bf4e5d0e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:12.800044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 546/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:12 2022] GET /identity/v3/roles/f473c53d5223450d931d5e666473c86b => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:12.809231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fede8-bff9-4238-9d34-dd0844a3d79d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:12.924977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fede8-bff9-4238-9d34-dd0844a3d79d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:12.940671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:12.973251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc1e4f-93cf-4779-a6a4-e8d1248e1e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:12.974133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc1e4f-93cf-4779-a6a4-e8d1248e1e65 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:12.974421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc1e4f-93cf-4779-a6a4-e8d1248e1e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:12.974697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc1e4f-93cf-4779-a6a4-e8d1248e1e65 None admin] PATH_INFO: `/v3/users/a1b7dc7b5f7946ac9554dc0b2fd5389c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:12.988178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc1e4f-93cf-4779-a6a4-e8d1248e1e65 None admin] RBAC: Authorizing `identity:get_user(user_id=a1b7dc7b5f7946ac9554dc0b2fd5389c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:12.989616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc1e4f-93cf-4779-a6a4-e8d1248e1e65 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:12.991321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 568/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:12 2022] GET /identity/v3/users/a1b7dc7b5f7946ac9554dc0b2fd5389c => generated 286 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:12.997605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae06ee4-1d9e-4c17-9284-ddd0bf4e5d0e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:13.043271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:13.120887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae06ee4-1d9e-4c17-9284-ddd0bf4e5d0e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:13.157711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee5a9-b547-4a21-8bb9-5b4afcb199ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:13.158357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee5a9-b547-4a21-8bb9-5b4afcb199ea None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:13.158642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee5a9-b547-4a21-8bb9-5b4afcb199ea None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:13.158911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ee5a9-b547-4a21-8bb9-5b4afcb199ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:13.239171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee5a9-b547-4a21-8bb9-5b4afcb199ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:13.240680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97ee5a9-b547-4a21-8bb9-5b4afcb199ea None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:13.280997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:13.341775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 547/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:13.348743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc1e4f-93cf-4779-a6a4-e8d1248e1e65 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:13.461461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc1e4f-93cf-4779-a6a4-e8d1248e1e65 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:13.496867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8987de-01b4-4a80-894a-a3ad2deab977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:13.497729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8987de-01b4-4a80-894a-a3ad2deab977 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:13.498007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8987de-01b4-4a80-894a-a3ad2deab977 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:13.498286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8987de-01b4-4a80-894a-a3ad2deab977 None admin] PATH_INFO: `/v3/projects/e224d804a11244b4a486cd18cfd6aca4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:13.499528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8987de-01b4-4a80-894a-a3ad2deab977 None admin] RBAC: Authorizing `identity:get_project(project_id=e224d804a11244b4a486cd18cfd6aca4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:13.501012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8987de-01b4-4a80-894a-a3ad2deab977 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:13.502741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 569/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:13 2022] GET /identity/v3/projects/e224d804a11244b4a486cd18cfd6aca4 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:13.509520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee5a9-b547-4a21-8bb9-5b4afcb199ea None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:13.625710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ee5a9-b547-4a21-8bb9-5b4afcb199ea None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:13.662364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0714bf43-05c3-4622-b354-117d3521366e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:13.663031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714bf43-05c3-4622-b354-117d3521366e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:13.663316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714bf43-05c3-4622-b354-117d3521366e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:13.663590 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0714bf43-05c3-4622-b354-117d3521366e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:13.664458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714bf43-05c3-4622-b354-117d3521366e None admin] RBAC: Adding query filter params (role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=e224d804a11244b4a486cd18cfd6aca4, user.id=a1b7dc7b5f7946ac9554dc0b2fd5389c) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:13.664772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714bf43-05c3-4622-b354-117d3521366e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:13.666245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0714bf43-05c3-4622-b354-117d3521366e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:13.671902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 548/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:13 2022] GET /identity/v3/role_assignments?user.id=a1b7dc7b5f7946ac9554dc0b2fd5389c&scope.project.id=e224d804a11244b4a486cd18cfd6aca4&role.id=f473c53d5223450d931d5e666473c86b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:15.628981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d296708-24f0-4e4e-8af1-ff4f1e12f1df None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:15.629615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d296708-24f0-4e4e-8af1-ff4f1e12f1df None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:15.629615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d296708-24f0-4e4e-8af1-ff4f1e12f1df None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:15.630915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 570/1118] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:15.637562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e8190-37b9-4d56-af9a-57c47f01e83e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:15.638333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e8190-37b9-4d56-af9a-57c47f01e83e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:15.638461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e8190-37b9-4d56-af9a-57c47f01e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:15.648409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:15.665163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5c6e8190-37b9-4d56-af9a-57c47f01e83e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:15.667146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5c6e8190-37b9-4d56-af9a-57c47f01e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:15.742389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 549/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:15.774126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d296708-24f0-4e4e-8af1-ff4f1e12f1df None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:15.818845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:15.879883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d296708-24f0-4e4e-8af1-ff4f1e12f1df None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:15.914223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10e580-1844-48a3-9fc1-655953e8667e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:15.915077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e580-1844-48a3-9fc1-655953e8667e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:15.915348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e580-1844-48a3-9fc1-655953e8667e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:15.915630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10e580-1844-48a3-9fc1-655953e8667e None admin] PATH_INFO: `/v3/roles/f473c53d5223450d931d5e666473c86b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:15.917133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10e580-1844-48a3-9fc1-655953e8667e None admin] RBAC: Authorizing `identity:get_role(role_id=f473c53d5223450d931d5e666473c86b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:15.918523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10e580-1844-48a3-9fc1-655953e8667e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:15.919938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 571/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:15 2022] GET /identity/v3/roles/f473c53d5223450d931d5e666473c86b => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:15.929569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e8190-37b9-4d56-af9a-57c47f01e83e None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:16.046700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e8190-37b9-4d56-af9a-57c47f01e83e None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:16.086057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c227f18-15fd-49ef-a32f-94128dae6842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:16.086979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227f18-15fd-49ef-a32f-94128dae6842 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:16.087259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227f18-15fd-49ef-a32f-94128dae6842 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:16.087559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c227f18-15fd-49ef-a32f-94128dae6842 None admin] PATH_INFO: `/v3/users/a1b7dc7b5f7946ac9554dc0b2fd5389c` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:16.088961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c227f18-15fd-49ef-a32f-94128dae6842 None admin] RBAC: Authorizing `identity:get_user(user_id=a1b7dc7b5f7946ac9554dc0b2fd5389c)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:16.090477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c227f18-15fd-49ef-a32f-94128dae6842 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:16.092223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 550/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:15 2022] GET /identity/v3/users/a1b7dc7b5f7946ac9554dc0b2fd5389c => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:16.101972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10e580-1844-48a3-9fc1-655953e8667e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:16.209027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10e580-1844-48a3-9fc1-655953e8667e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:16.217938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:16.244662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935447f-a345-4475-8b63-9f4b47d7f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:16.245513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935447f-a345-4475-8b63-9f4b47d7f4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:16.245794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935447f-a345-4475-8b63-9f4b47d7f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:16.246074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935447f-a345-4475-8b63-9f4b47d7f4a4 None admin] PATH_INFO: `/v3/projects/e224d804a11244b4a486cd18cfd6aca4` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:16.247343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935447f-a345-4475-8b63-9f4b47d7f4a4 None admin] RBAC: Authorizing `identity:get_project(project_id=e224d804a11244b4a486cd18cfd6aca4)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:16.248800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935447f-a345-4475-8b63-9f4b47d7f4a4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:16.250521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 572/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:16 2022] GET /identity/v3/projects/e224d804a11244b4a486cd18cfd6aca4 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:16.259963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c227f18-15fd-49ef-a32f-94128dae6842 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:16.263175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:16.388423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c227f18-15fd-49ef-a32f-94128dae6842 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:16.425711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d101c78-0c0f-4117-a650-4aa96a462679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:16.426624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d101c78-0c0f-4117-a650-4aa96a462679 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:16.426903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d101c78-0c0f-4117-a650-4aa96a462679 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:16.427182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d101c78-0c0f-4117-a650-4aa96a462679 None admin] PATH_INFO: `/v3/projects/e224d804a11244b4a486cd18cfd6aca4/users/a1b7dc7b5f7946ac9554dc0b2fd5389c/roles/f473c53d5223450d931d5e666473c86b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:16.429817 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d101c78-0c0f-4117-a650-4aa96a462679 None admin] RBAC: Authorizing `identity:create_grant(project_id=e224d804a11244b4a486cd18cfd6aca4, user_id=a1b7dc7b5f7946ac9554dc0b2fd5389c, role_id=f473c53d5223450d931d5e666473c86b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:16.431264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d101c78-0c0f-4117-a650-4aa96a462679 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:16.447504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 551/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:29:16 2022] PUT /identity/v3/projects/e224d804a11244b4a486cd18cfd6aca4/users/a1b7dc7b5f7946ac9554dc0b2fd5389c/roles/f473c53d5223450d931d5e666473c86b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:29:18.448214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164e41c-6a71-4c3f-a3f9-0a578e8b14e8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:18.448799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164e41c-6a71-4c3f-a3f9-0a578e8b14e8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:18.448799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4164e41c-6a71-4c3f-a3f9-0a578e8b14e8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:18.450655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 573/1124] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:18.457140 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4883-64f0-4d1a-abe7-a94dad6971d7 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:18.457552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4883-64f0-4d1a-abe7-a94dad6971d7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:18.457708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd4883-64f0-4d1a-abe7-a94dad6971d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:18.484180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b0cd4883-64f0-4d1a-abe7-a94dad6971d7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:18.485369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b0cd4883-64f0-4d1a-abe7-a94dad6971d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:18.545583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:18.558165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 552/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:18.588411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164e41c-6a71-4c3f-a3f9-0a578e8b14e8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:18.695630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4164e41c-6a71-4c3f-a3f9-0a578e8b14e8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:18.732769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9ccf8-d578-4254-b10c-2977ab069533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:18.733546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9ccf8-d578-4254-b10c-2977ab069533 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:18.733825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9ccf8-d578-4254-b10c-2977ab069533 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:18.734093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9ccf8-d578-4254-b10c-2977ab069533 None admin] PATH_INFO: `/v3/roles/f473c53d5223450d931d5e666473c86b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:18.735648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9ccf8-d578-4254-b10c-2977ab069533 None admin] RBAC: Authorizing `identity:get_role(role_id=f473c53d5223450d931d5e666473c86b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:18.737028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9ccf8-d578-4254-b10c-2977ab069533 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:18.738413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 574/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:18 2022] GET /identity/v3/roles/f473c53d5223450d931d5e666473c86b => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:18.745191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd4883-64f0-4d1a-abe7-a94dad6971d7 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:18.859172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd4883-64f0-4d1a-abe7-a94dad6971d7 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:18.901000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680c773-72f3-4016-b4cc-3e456bc0fe9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:18.901891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c773-72f3-4016-b4cc-3e456bc0fe9e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:18.902171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c773-72f3-4016-b4cc-3e456bc0fe9e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:18.902445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680c773-72f3-4016-b4cc-3e456bc0fe9e None admin] PATH_INFO: `/v3/users/a1b7dc7b5f7946ac9554dc0b2fd5389c` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:18.903805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680c773-72f3-4016-b4cc-3e456bc0fe9e None admin] RBAC: Authorizing `identity:get_user(user_id=a1b7dc7b5f7946ac9554dc0b2fd5389c)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:18.905254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680c773-72f3-4016-b4cc-3e456bc0fe9e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:18.906935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 553/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:18 2022] GET /identity/v3/users/a1b7dc7b5f7946ac9554dc0b2fd5389c => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:18.913129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9ccf8-d578-4254-b10c-2977ab069533 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:18.974657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:19.029462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9ccf8-d578-4254-b10c-2977ab069533 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:19.065057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a5b55-aa23-413c-b9c0-4be29013bca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:19.065735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a5b55-aa23-413c-b9c0-4be29013bca7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:19.066016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a5b55-aa23-413c-b9c0-4be29013bca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:19.066290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a5b55-aa23-413c-b9c0-4be29013bca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:19.138737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a5b55-aa23-413c-b9c0-4be29013bca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:19.140217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5a5b55-aa23-413c-b9c0-4be29013bca7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:19.185363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:19.241240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 575/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 13:29:19.251001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680c773-72f3-4016-b4cc-3e456bc0fe9e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:19.318406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:19.364117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680c773-72f3-4016-b4cc-3e456bc0fe9e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:19.410566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf5300d-4c05-4952-86da-2640b4b6f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:19.411433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5300d-4c05-4952-86da-2640b4b6f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:19.411744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5300d-4c05-4952-86da-2640b4b6f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:19.412021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf5300d-4c05-4952-86da-2640b4b6f1f3 None admin] PATH_INFO: `/v3/projects/e224d804a11244b4a486cd18cfd6aca4` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:19.413255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5300d-4c05-4952-86da-2640b4b6f1f3 None admin] RBAC: Authorizing `identity:get_project(project_id=e224d804a11244b4a486cd18cfd6aca4)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:19.414674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf5300d-4c05-4952-86da-2640b4b6f1f3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:19.416417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 554/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:19 2022] GET /identity/v3/projects/e224d804a11244b4a486cd18cfd6aca4 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:19.426431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a5b55-aa23-413c-b9c0-4be29013bca7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:19.535807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5a5b55-aa23-413c-b9c0-4be29013bca7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:19.571327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b138eb9-e750-438d-83d3-6c67da4ad778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:19.571950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138eb9-e750-438d-83d3-6c67da4ad778 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:19.572233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138eb9-e750-438d-83d3-6c67da4ad778 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:19.572508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b138eb9-e750-438d-83d3-6c67da4ad778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:19.573344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b138eb9-e750-438d-83d3-6c67da4ad778 None admin] RBAC: Adding query filter params (role.id=f473c53d5223450d931d5e666473c86b, scope.project.id=e224d804a11244b4a486cd18cfd6aca4, user.id=a1b7dc7b5f7946ac9554dc0b2fd5389c) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:19.573657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b138eb9-e750-438d-83d3-6c67da4ad778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:19.575136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b138eb9-e750-438d-83d3-6c67da4ad778 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:19.581045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 576/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:19 2022] GET /identity/v3/role_assignments?user.id=a1b7dc7b5f7946ac9554dc0b2fd5389c&scope.project.id=e224d804a11244b4a486cd18cfd6aca4&role.id=f473c53d5223450d931d5e666473c86b => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:21.580395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5be10-0568-4923-b0f7-5780c21087cb None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:21.580987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5be10-0568-4923-b0f7-5780c21087cb None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:21.580987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5be10-0568-4923-b0f7-5780c21087cb None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:21.582311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 555/1131] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:21.588596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f7861-15ca-4645-9c4e-2b2707d58905 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:21.589320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f7861-15ca-4645-9c4e-2b2707d58905 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:21.589439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f7861-15ca-4645-9c4e-2b2707d58905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:21.613465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-548f7861-15ca-4645-9c4e-2b2707d58905 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:21.614681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-548f7861-15ca-4645-9c4e-2b2707d58905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:21.616620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:21.699655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 577/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:21.722758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5be10-0568-4923-b0f7-5780c21087cb None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:21.830046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5be10-0568-4923-b0f7-5780c21087cb None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:21.859089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:21.868572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6469896e-14de-4e2e-9bd5-de47ccb9eeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:21.869358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469896e-14de-4e2e-9bd5-de47ccb9eeae None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:21.869636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469896e-14de-4e2e-9bd5-de47ccb9eeae None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:21.869903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6469896e-14de-4e2e-9bd5-de47ccb9eeae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:21.871121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469896e-14de-4e2e-9bd5-de47ccb9eeae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:21.872611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6469896e-14de-4e2e-9bd5-de47ccb9eeae None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:21.874190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 556/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:21.880231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f7861-15ca-4645-9c4e-2b2707d58905 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:21.980754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f7861-15ca-4645-9c4e-2b2707d58905 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:22.015621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63e74f-b66d-4400-86d1-c4eec5727dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:22.016293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e74f-b66d-4400-86d1-c4eec5727dc0 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:22.016572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e74f-b66d-4400-86d1-c4eec5727dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:22.016845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e74f-b66d-4400-86d1-c4eec5727dc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:22.017550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63e74f-b66d-4400-86d1-c4eec5727dc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:22.018969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63e74f-b66d-4400-86d1-c4eec5727dc0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:22.026941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:22.047626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 578/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:29:21 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:29:24.042439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1ecf-74ff-488c-83b8-ccbcba93bd1d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:24.043267 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1ecf-74ff-488c-83b8-ccbcba93bd1d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:24.043267 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1ecf-74ff-488c-83b8-ccbcba93bd1d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:24.045501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 557/1135] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:24.050792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664d46-459e-45d4-98a5-e589aa785cb4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:24.051227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664d46-459e-45d4-98a5-e589aa785cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:24.051325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664d46-459e-45d4-98a5-e589aa785cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:24.069649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-67664d46-459e-45d4-98a5-e589aa785cb4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:24.070810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-67664d46-459e-45d4-98a5-e589aa785cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:24.137998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 579/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:24.161848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c1ecf-74ff-488c-83b8-ccbcba93bd1d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:24.265548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c1ecf-74ff-488c-83b8-ccbcba93bd1d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:24.300272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563b1edf-0e19-453b-ae17-ae2b60a75db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:24.300979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b1edf-0e19-453b-ae17-ae2b60a75db0 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:24.301258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b1edf-0e19-453b-ae17-ae2b60a75db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:24.301528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b1edf-0e19-453b-ae17-ae2b60a75db0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:24.302804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b1edf-0e19-453b-ae17-ae2b60a75db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:24.304257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563b1edf-0e19-453b-ae17-ae2b60a75db0 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:24.305833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 558/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:29:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:24.311907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67664d46-459e-45d4-98a5-e589aa785cb4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:24.410234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67664d46-459e-45d4-98a5-e589aa785cb4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:24.430806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:24.447232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f42db6-3328-4419-86be-7ddfaabbf4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:24.447939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42db6-3328-4419-86be-7ddfaabbf4a4 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:24.448221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42db6-3328-4419-86be-7ddfaabbf4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:24.448494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42db6-3328-4419-86be-7ddfaabbf4a4 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:24.449210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f42db6-3328-4419-86be-7ddfaabbf4a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:24.450733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f42db6-3328-4419-86be-7ddfaabbf4a4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:24.472707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 580/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:29:24 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:29:26.510766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27a22-6f31-42cc-a964-0e96a3b1f2d2 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:26.511689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27a22-6f31-42cc-a964-0e96a3b1f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:26.511689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27a22-6f31-42cc-a964-0e96a3b1f2d2 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:26.513860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 559/1139] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:26.519333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a463-6477-4356-ad0b-96dfe94a93af None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:26.519792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a463-6477-4356-ad0b-96dfe94a93af None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:26.519885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0853a463-6477-4356-ad0b-96dfe94a93af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:26.537837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0853a463-6477-4356-ad0b-96dfe94a93af None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:26.539009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0853a463-6477-4356-ad0b-96dfe94a93af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:26.623159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 581/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:26.652443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f27a22-6f31-42cc-a964-0e96a3b1f2d2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:26.718080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:26.757422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f27a22-6f31-42cc-a964-0e96a3b1f2d2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:26.793132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855df7c-1970-40d2-ab5f-627a636b9bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:26.793948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855df7c-1970-40d2-ab5f-627a636b9bef None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:26.794226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855df7c-1970-40d2-ab5f-627a636b9bef None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:26.794495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855df7c-1970-40d2-ab5f-627a636b9bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:26.805580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855df7c-1970-40d2-ab5f-627a636b9bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-d855df7c-1970-40d2-ab5f-627a636b9bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:26.813436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:26.814501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:26.815470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 560/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:26.821495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853a463-6477-4356-ad0b-96dfe94a93af None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:26.937421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0853a463-6477-4356-ad0b-96dfe94a93af None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:26.945216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:26.974990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:26.975646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:26.975953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:26.976227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:26.976974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:26.977253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:26.978642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:26.986652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 582/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:26.992484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855df7c-1970-40d2-ab5f-627a636b9bef None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:27.100654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855df7c-1970-40d2-ab5f-627a636b9bef None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:27.124238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:27.136576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0657316-1721-486f-abd5-0ed6009ff6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:27.137477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657316-1721-486f-abd5-0ed6009ff6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:27.137754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657316-1721-486f-abd5-0ed6009ff6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:27.138022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0657316-1721-486f-abd5-0ed6009ff6a1 None admin] PATH_INFO: `/v3/users/771101200b4c4648b9a7a3836d1c9d73` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:27.151934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0657316-1721-486f-abd5-0ed6009ff6a1 None admin] RBAC: Authorizing `identity:get_user(user_id=771101200b4c4648b9a7a3836d1c9d73)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:27.153445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0657316-1721-486f-abd5-0ed6009ff6a1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:27.155106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 561/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:26 2022] GET /identity/v3/users/771101200b4c4648b9a7a3836d1c9d73 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:27.161128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:27.263823 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f59983-0f00-4826-ac13-2e40bad043c6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:27.298436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8461ca-923d-4f14-8671-a030fdd6c6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:27.299077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8461ca-923d-4f14-8671-a030fdd6c6ab None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:27.299359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8461ca-923d-4f14-8671-a030fdd6c6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:27.299647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8461ca-923d-4f14-8671-a030fdd6c6ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:27.334308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:27.368155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8461ca-923d-4f14-8671-a030fdd6c6ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:27.369541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8461ca-923d-4f14-8671-a030fdd6c6ab None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:27.469361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 583/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:27.476201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0657316-1721-486f-abd5-0ed6009ff6a1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:27.585939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0657316-1721-486f-abd5-0ed6009ff6a1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:27.624872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c02aff-debb-449c-bf70-37e923fa0ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:27.625664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c02aff-debb-449c-bf70-37e923fa0ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:27.625938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c02aff-debb-449c-bf70-37e923fa0ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:27.626206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c02aff-debb-449c-bf70-37e923fa0ee8 None admin] PATH_INFO: `/v3/projects/eb03dc32a91a4da9bb68a3411573742e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:27.627513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c02aff-debb-449c-bf70-37e923fa0ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=eb03dc32a91a4da9bb68a3411573742e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:27.628972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c02aff-debb-449c-bf70-37e923fa0ee8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:27.630674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 562/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:27 2022] GET /identity/v3/projects/eb03dc32a91a4da9bb68a3411573742e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:27.637215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8461ca-923d-4f14-8671-a030fdd6c6ab None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:27.714453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:27.748884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8461ca-923d-4f14-8671-a030fdd6c6ab None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:27.785101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d3dac-5fa3-472d-83b1-b2948f8ba89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:27.785734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3dac-5fa3-472d-83b1-b2948f8ba89e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:27.786021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3dac-5fa3-472d-83b1-b2948f8ba89e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:27.786298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d3dac-5fa3-472d-83b1-b2948f8ba89e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:27.787127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d3dac-5fa3-472d-83b1-b2948f8ba89e None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=eb03dc32a91a4da9bb68a3411573742e, user.id=771101200b4c4648b9a7a3836d1c9d73) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:27.787442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d3dac-5fa3-472d-83b1-b2948f8ba89e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:27.788909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d3dac-5fa3-472d-83b1-b2948f8ba89e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:27.794586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 584/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:27 2022] GET /identity/v3/role_assignments?user.id=771101200b4c4648b9a7a3836d1c9d73&scope.project.id=eb03dc32a91a4da9bb68a3411573742e&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:29.761089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39083b5e-5df8-4ec2-b533-9def7854390e None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:29.761905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39083b5e-5df8-4ec2-b533-9def7854390e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:29.762036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39083b5e-5df8-4ec2-b533-9def7854390e None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:29.763738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 563/1147] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:29.769989 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83cf7-f9ad-439a-b9e4-34b61788f5af None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:29.770451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83cf7-f9ad-439a-b9e4-34b61788f5af None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:29.770544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad83cf7-f9ad-439a-b9e4-34b61788f5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:29.798149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8ad83cf7-f9ad-439a-b9e4-34b61788f5af None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:29.799344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8ad83cf7-f9ad-439a-b9e4-34b61788f5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:29.877260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 585/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:29.900187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39083b5e-5df8-4ec2-b533-9def7854390e None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:29.959954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:30.013893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39083b5e-5df8-4ec2-b533-9def7854390e None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:30.055135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06059-b168-45a0-baf8-f1a75ae3dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:30.055962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06059-b168-45a0-baf8-f1a75ae3dc07 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:30.056246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06059-b168-45a0-baf8-f1a75ae3dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:30.056522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc06059-b168-45a0-baf8-f1a75ae3dc07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:30.067976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc06059-b168-45a0-baf8-f1a75ae3dc07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-9bc06059-b168-45a0-baf8-f1a75ae3dc07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:30.075518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:30.076501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:30.077320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 564/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:30.089270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad83cf7-f9ad-439a-b9e4-34b61788f5af None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:30.163921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:30.205692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad83cf7-f9ad-439a-b9e4-34b61788f5af None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:30.241127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:30.241707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:30.241986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:30.242255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:30.242996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:30.243426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:30.244708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:30.253365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 586/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:30.262509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06059-b168-45a0-baf8-f1a75ae3dc07 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:30.385471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc06059-b168-45a0-baf8-f1a75ae3dc07 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:30.395858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:30.421803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf1f6-b67a-449f-be0d-040865f71a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:30.422667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf1f6-b67a-449f-be0d-040865f71a6b None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:30.422951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf1f6-b67a-449f-be0d-040865f71a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:30.423220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acf1f6-b67a-449f-be0d-040865f71a6b None admin] PATH_INFO: `/v3/users/771101200b4c4648b9a7a3836d1c9d73` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:30.424501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acf1f6-b67a-449f-be0d-040865f71a6b None admin] RBAC: Authorizing `identity:get_user(user_id=771101200b4c4648b9a7a3836d1c9d73)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:30.425937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acf1f6-b67a-449f-be0d-040865f71a6b None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:30.427558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 565/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:30 2022] GET /identity/v3/users/771101200b4c4648b9a7a3836d1c9d73 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:30.433948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:30.535982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46083849-e25c-4045-b3d9-9d22fc193b9c None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:30.558896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:30.577374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3621c79-46d6-4ef4-b367-c1033a317f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:30.578239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621c79-46d6-4ef4-b367-c1033a317f75 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:30.578520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621c79-46d6-4ef4-b367-c1033a317f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:30.578798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3621c79-46d6-4ef4-b367-c1033a317f75 None admin] PATH_INFO: `/v3/projects/eb03dc32a91a4da9bb68a3411573742e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:30.580149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3621c79-46d6-4ef4-b367-c1033a317f75 None admin] RBAC: Authorizing `identity:get_project(project_id=eb03dc32a91a4da9bb68a3411573742e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:30.581587 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3621c79-46d6-4ef4-b367-c1033a317f75 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:30.583307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 587/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:30 2022] GET /identity/v3/projects/eb03dc32a91a4da9bb68a3411573742e => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:29:30.589800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf1f6-b67a-449f-be0d-040865f71a6b None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:30.699325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acf1f6-b67a-449f-be0d-040865f71a6b None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:30.734404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21992bda-517a-4bf3-a536-c45a0c84450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:30.735288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992bda-517a-4bf3-a536-c45a0c84450f None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:30.735563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992bda-517a-4bf3-a536-c45a0c84450f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:30.735866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21992bda-517a-4bf3-a536-c45a0c84450f None admin] PATH_INFO: `/v3/projects/eb03dc32a91a4da9bb68a3411573742e/users/771101200b4c4648b9a7a3836d1c9d73/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:30.738105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21992bda-517a-4bf3-a536-c45a0c84450f None admin] RBAC: Authorizing `identity:create_grant(project_id=eb03dc32a91a4da9bb68a3411573742e, user_id=771101200b4c4648b9a7a3836d1c9d73, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:30.739545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21992bda-517a-4bf3-a536-c45a0c84450f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:30.756839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 566/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:29:30 2022] PUT /identity/v3/projects/eb03dc32a91a4da9bb68a3411573742e/users/771101200b4c4648b9a7a3836d1c9d73/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:29:32.734943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712c4b-fc72-4935-8339-d28aacbba634 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:32.735491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712c4b-fc72-4935-8339-d28aacbba634 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:32.735491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b712c4b-fc72-4935-8339-d28aacbba634 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:32.737706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 588/1154] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:32.746245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47adf3-46da-42ea-aa78-68dd663a35d5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:32.746677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47adf3-46da-42ea-aa78-68dd663a35d5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:32.746852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47adf3-46da-42ea-aa78-68dd663a35d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:32.770771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-8b47adf3-46da-42ea-aa78-68dd663a35d5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:32.772025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8b47adf3-46da-42ea-aa78-68dd663a35d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:32.803506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:32.846300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 567/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:32.870398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b712c4b-fc72-4935-8339-d28aacbba634 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:32.991964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b712c4b-fc72-4935-8339-d28aacbba634 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:33.028316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4b4f3-d110-450d-b468-d05ce600f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:33.029122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4b4f3-d110-450d-b468-d05ce600f0cf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:33.029399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4b4f3-d110-450d-b468-d05ce600f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:33.029615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4b4f3-d110-450d-b468-d05ce600f0cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:33.039845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4b4f3-d110-450d-b468-d05ce600f0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-71e4b4f3-d110-450d-b468-d05ce600f0cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:33.047361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:33.048470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:33.049574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 589/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:33.054961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47adf3-46da-42ea-aa78-68dd663a35d5 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:33.160059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47adf3-46da-42ea-aa78-68dd663a35d5 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:33.196304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:33.196969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:33.197249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:33.197518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:33.198268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:33.198576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:33.199997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:33.208960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 568/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:33.215733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4b4f3-d110-450d-b468-d05ce600f0cf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:33.280551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:33.341308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4b4f3-d110-450d-b468-d05ce600f0cf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:33.374468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754f3be-6332-4d00-8e85-525c2cb457d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:33.375344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f3be-6332-4d00-8e85-525c2cb457d7 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:33.375646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f3be-6332-4d00-8e85-525c2cb457d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:33.375912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754f3be-6332-4d00-8e85-525c2cb457d7 None admin] PATH_INFO: `/v3/users/771101200b4c4648b9a7a3836d1c9d73` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:33.377121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754f3be-6332-4d00-8e85-525c2cb457d7 None admin] RBAC: Authorizing `identity:get_user(user_id=771101200b4c4648b9a7a3836d1c9d73)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:33.378599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754f3be-6332-4d00-8e85-525c2cb457d7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:33.380460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 590/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:33 2022] GET /identity/v3/users/771101200b4c4648b9a7a3836d1c9d73 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:33.386956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:33.421285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:33.494936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be7eda-7a9a-40c1-96b7-960f4967d1fa None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:33.530731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1b9be-6938-49bf-8fad-f3f6ba3edc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:33.531330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b9be-6938-49bf-8fad-f3f6ba3edc64 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:33.531645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b9be-6938-49bf-8fad-f3f6ba3edc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:33.531915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1b9be-6938-49bf-8fad-f3f6ba3edc64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:33.610485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1b9be-6938-49bf-8fad-f3f6ba3edc64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:33.612513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1b9be-6938-49bf-8fad-f3f6ba3edc64 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:33.657371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:33.736489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 569/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:33.746032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754f3be-6332-4d00-8e85-525c2cb457d7 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:33.856988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754f3be-6332-4d00-8e85-525c2cb457d7 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:33.876623 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:33.892264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7907c-9823-4828-af19-2c3dc442ce3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:33.893120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7907c-9823-4828-af19-2c3dc442ce3d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:33.893397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7907c-9823-4828-af19-2c3dc442ce3d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:33.893668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7907c-9823-4828-af19-2c3dc442ce3d None admin] PATH_INFO: `/v3/projects/eb03dc32a91a4da9bb68a3411573742e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:33.894962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7907c-9823-4828-af19-2c3dc442ce3d None admin] RBAC: Authorizing `identity:get_project(project_id=eb03dc32a91a4da9bb68a3411573742e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:33.896418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7907c-9823-4828-af19-2c3dc442ce3d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:33.898109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 591/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:33 2022] GET /identity/v3/projects/eb03dc32a91a4da9bb68a3411573742e => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:33.904469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1b9be-6938-49bf-8fad-f3f6ba3edc64 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:34.007159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1b9be-6938-49bf-8fad-f3f6ba3edc64 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:34.036557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:34.043713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e7fb0-06cd-47c6-961f-a04503a39e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:34.044381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7fb0-06cd-47c6-961f-a04503a39e6a None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:34.044661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7fb0-06cd-47c6-961f-a04503a39e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:34.044918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e7fb0-06cd-47c6-961f-a04503a39e6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:34.045773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e7fb0-06cd-47c6-961f-a04503a39e6a None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=eb03dc32a91a4da9bb68a3411573742e, user.id=771101200b4c4648b9a7a3836d1c9d73) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:34.046086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e7fb0-06cd-47c6-961f-a04503a39e6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:34.047533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e7fb0-06cd-47c6-961f-a04503a39e6a None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:34.053745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 570/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:33 2022] GET /identity/v3/role_assignments?user.id=771101200b4c4648b9a7a3836d1c9d73&scope.project.id=eb03dc32a91a4da9bb68a3411573742e&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:36.102927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e58db-66f5-487f-b3f3-fa4497099c78 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:36.103752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e58db-66f5-487f-b3f3-fa4497099c78 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:36.103752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e58db-66f5-487f-b3f3-fa4497099c78 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:36.106047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 592/1162] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:36.113947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c30859-e753-4039-9218-1c2d15ebbcfe None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:36.114409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c30859-e753-4039-9218-1c2d15ebbcfe None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:36.114502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c30859-e753-4039-9218-1c2d15ebbcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:36.132327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b2c30859-e753-4039-9218-1c2d15ebbcfe None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:36.133508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b2c30859-e753-4039-9218-1c2d15ebbcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:36.210548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 571/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:29:36.232978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e58db-66f5-487f-b3f3-fa4497099c78 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:36.338256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e58db-66f5-487f-b3f3-fa4497099c78 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:36.373022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4882699-7777-4577-85a3-7bab84c32fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:36.373602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4882699-7777-4577-85a3-7bab84c32fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:36.373878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4882699-7777-4577-85a3-7bab84c32fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:36.374148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4882699-7777-4577-85a3-7bab84c32fc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:36.429419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:36.444180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4882699-7777-4577-85a3-7bab84c32fc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:36.445638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4882699-7777-4577-85a3-7bab84c32fc5 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:36.551967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 593/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:36.558355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c30859-e753-4039-9218-1c2d15ebbcfe None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:36.657553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c30859-e753-4039-9218-1c2d15ebbcfe None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:36.689446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:36.703534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5c2fc-8956-41dc-b29a-eeecbf004a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:36.704397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c2fc-8956-41dc-b29a-eeecbf004a31 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:36.704688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c2fc-8956-41dc-b29a-eeecbf004a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:36.704963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c2fc-8956-41dc-b29a-eeecbf004a31 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:36.712517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5c2fc-8956-41dc-b29a-eeecbf004a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:36.713976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5c2fc-8956-41dc-b29a-eeecbf004a31 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-04b5c2fc-8956-41dc-b29a-eeecbf004a31 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:36.729011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:36.730197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:36.731883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 572/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:29:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:36.740762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4882699-7777-4577-85a3-7bab84c32fc5 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:36.832538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:36.845183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4882699-7777-4577-85a3-7bab84c32fc5 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:36.879956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d7549-a2e2-45aa-928d-c39d2dad06cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:36.880625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d7549-a2e2-45aa-928d-c39d2dad06cc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:36.880897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d7549-a2e2-45aa-928d-c39d2dad06cc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:36.881165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d7549-a2e2-45aa-928d-c39d2dad06cc None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:36.881885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d7549-a2e2-45aa-928d-c39d2dad06cc None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:36.882186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d7549-a2e2-45aa-928d-c39d2dad06cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:36.883574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d7549-a2e2-45aa-928d-c39d2dad06cc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:36.890861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 594/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Tue Jul 12 13:29:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:38.876043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286a86-3eed-487b-8f90-be8439575eb0 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:38.876939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286a86-3eed-487b-8f90-be8439575eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:38.876939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09286a86-3eed-487b-8f90-be8439575eb0 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:38.879265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 573/1167] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:38.888240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe978e9-1d9d-4561-b2b6-d3f75a004e6f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:38.888669 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe978e9-1d9d-4561-b2b6-d3f75a004e6f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:38.888758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe978e9-1d9d-4561-b2b6-d3f75a004e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:38.907071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-efe978e9-1d9d-4561-b2b6-d3f75a004e6f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:38.908252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-efe978e9-1d9d-4561-b2b6-d3f75a004e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:38.979093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 595/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:39.002735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09286a86-3eed-487b-8f90-be8439575eb0 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:39.121134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09286a86-3eed-487b-8f90-be8439575eb0 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:39.156214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c209e-34ac-495a-b83b-a69b51c3f302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:39.156860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c209e-34ac-495a-b83b-a69b51c3f302 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:39.157204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c209e-34ac-495a-b83b-a69b51c3f302 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:39.157411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c209e-34ac-495a-b83b-a69b51c3f302 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:39.158156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c209e-34ac-495a-b83b-a69b51c3f302 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:39.159540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c209e-34ac-495a-b83b-a69b51c3f302 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:39.177967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 574/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Tue Jul 12 13:29:39 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:29:41.226081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4f997-44c6-4e08-bb4c-e409b5f11cb7 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:41.226985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4f997-44c6-4e08-bb4c-e409b5f11cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:41.226985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe4f997-44c6-4e08-bb4c-e409b5f11cb7 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:41.229222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 596/1170] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:41.235768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bddf9-9ba3-47f4-9efa-cb7a5981ce91 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:41.236228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bddf9-9ba3-47f4-9efa-cb7a5981ce91 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:41.236344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bddf9-9ba3-47f4-9efa-cb7a5981ce91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:41.259925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-8c8bddf9-9ba3-47f4-9efa-cb7a5981ce91 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:41.261164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8c8bddf9-9ba3-47f4-9efa-cb7a5981ce91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:41.303337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:41.332115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 575/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:41.356255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4f997-44c6-4e08-bb4c-e409b5f11cb7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:41.447067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:41.477005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe4f997-44c6-4e08-bb4c-e409b5f11cb7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:41.516502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff841cb-243b-4fc5-8cd7-fb6044f68543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:41.517369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff841cb-243b-4fc5-8cd7-fb6044f68543 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:41.517644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff841cb-243b-4fc5-8cd7-fb6044f68543 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:41.517922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff841cb-243b-4fc5-8cd7-fb6044f68543 None admin] PATH_INFO: `/v3/domains/8952f1a3f69e4f81908a3143027ef8b2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:41.529062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff841cb-243b-4fc5-8cd7-fb6044f68543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8952f1a3f69e4f81908a3143027ef8b2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:41.530482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff841cb-243b-4fc5-8cd7-fb6044f68543 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:41.532159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 597/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Tue Jul 12 13:29:41 2022] GET /identity/v3/domains/8952f1a3f69e4f81908a3143027ef8b2 => generated 267 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:41.541233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bddf9-9ba3-47f4-9efa-cb7a5981ce91 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:41.653305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bddf9-9ba3-47f4-9efa-cb7a5981ce91 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:41.700249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0921b-d825-4f19-b3cc-774a3ec46cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:41.700909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0921b-d825-4f19-b3cc-774a3ec46cde None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:41.701187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0921b-d825-4f19-b3cc-774a3ec46cde None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:41.701457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0921b-d825-4f19-b3cc-774a3ec46cde None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:41.702168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0921b-d825-4f19-b3cc-774a3ec46cde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:41.703634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0921b-d825-4f19-b3cc-774a3ec46cde None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:41.732552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 576/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:29:41 2022] POST /identity/v3/projects => generated 361 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:29:43.782101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247b7d-767e-4a73-9c97-abff4f95e983 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:43.782650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247b7d-767e-4a73-9c97-abff4f95e983 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:43.782650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2247b7d-767e-4a73-9c97-abff4f95e983 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:43.784973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 598/1174] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:43.793874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de499b-c5f1-4656-94d6-1767b8539aa5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:43.794256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de499b-c5f1-4656-94d6-1767b8539aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:43.794442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de499b-c5f1-4656-94d6-1767b8539aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:43.812643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-c0de499b-c5f1-4656-94d6-1767b8539aa5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:43.813858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c0de499b-c5f1-4656-94d6-1767b8539aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:43.834251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:43.891901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 577/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:43.919147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247b7d-767e-4a73-9c97-abff4f95e983 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:44.039738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2247b7d-767e-4a73-9c97-abff4f95e983 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:44.081335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ef00f-ac40-4995-aec8-5fab551ec19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:44.082276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ef00f-ac40-4995-aec8-5fab551ec19e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:44.082553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ef00f-ac40-4995-aec8-5fab551ec19e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:44.082826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ef00f-ac40-4995-aec8-5fab551ec19e None admin] PATH_INFO: `/v3/domains/8952f1a3f69e4f81908a3143027ef8b2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:44.084181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ef00f-ac40-4995-aec8-5fab551ec19e None admin] RBAC: Authorizing `identity:get_domain(domain_id=8952f1a3f69e4f81908a3143027ef8b2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:44.086059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ef00f-ac40-4995-aec8-5fab551ec19e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:44.087743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 599/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Tue Jul 12 13:29:43 2022] GET /identity/v3/domains/8952f1a3f69e4f81908a3143027ef8b2 => generated 267 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:44.095827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de499b-c5f1-4656-94d6-1767b8539aa5 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:44.206685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de499b-c5f1-4656-94d6-1767b8539aa5 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:44.246951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c31fc8-c348-4830-a575-f3063ba587d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:44.247665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c31fc8-c348-4830-a575-f3063ba587d4 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:44.247970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c31fc8-c348-4830-a575-f3063ba587d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:44.248243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c31fc8-c348-4830-a575-f3063ba587d4 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:44.248974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c31fc8-c348-4830-a575-f3063ba587d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:44.250398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c31fc8-c348-4830-a575-f3063ba587d4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:44.274395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 578/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:29:44 2022] POST /identity/v3/users => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:29:46.357423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef596af-b10c-4da9-abaf-b2b42a3f196f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:46.358041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef596af-b10c-4da9-abaf-b2b42a3f196f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:46.358041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef596af-b10c-4da9-abaf-b2b42a3f196f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:46.360536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 600/1178] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:46.369508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4546b-c25d-43fc-9c49-ee558b414853 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:46.369929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4546b-c25d-43fc-9c49-ee558b414853 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:46.370103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd4546b-c25d-43fc-9c49-ee558b414853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:46.394516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-abd4546b-c25d-43fc-9c49-ee558b414853 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:46.395764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-abd4546b-c25d-43fc-9c49-ee558b414853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:46.404032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:46.470238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 579/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:46.494637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef596af-b10c-4da9-abaf-b2b42a3f196f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:46.508932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:46.608808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef596af-b10c-4da9-abaf-b2b42a3f196f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:46.643703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923f1e-78ff-44cb-8374-246526c87d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:46.644503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923f1e-78ff-44cb-8374-246526c87d73 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:46.644790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923f1e-78ff-44cb-8374-246526c87d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:46.645060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8923f1e-78ff-44cb-8374-246526c87d73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:46.656429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8923f1e-78ff-44cb-8374-246526c87d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-e8923f1e-78ff-44cb-8374-246526c87d73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:46.664057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:46.665131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:46.669980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 601/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:46.671641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4546b-c25d-43fc-9c49-ee558b414853 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:46.775439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd4546b-c25d-43fc-9c49-ee558b414853 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:46.811680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:46.812358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:46.812642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:46.812925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:46.813685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:46.813996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:46.815385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:46.823809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 580/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:46.830063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923f1e-78ff-44cb-8374-246526c87d73 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:46.900785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:46.933697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8923f1e-78ff-44cb-8374-246526c87d73 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:46.970515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c62d1-6420-4add-961b-ee3dbb2dba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:46.971391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c62d1-6420-4add-961b-ee3dbb2dba18 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:46.971702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c62d1-6420-4add-961b-ee3dbb2dba18 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:46.971982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c62d1-6420-4add-961b-ee3dbb2dba18 None admin] PATH_INFO: `/v3/users/6ba66ae5f28e4e6d9afe478a7eeb3d7b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:46.985548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c62d1-6420-4add-961b-ee3dbb2dba18 None admin] RBAC: Authorizing `identity:get_user(user_id=6ba66ae5f28e4e6d9afe478a7eeb3d7b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:46.986982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00c62d1-6420-4add-961b-ee3dbb2dba18 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:46.988739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 602/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:46 2022] GET /identity/v3/users/6ba66ae5f28e4e6d9afe478a7eeb3d7b => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:46.995155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:46.999788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:47.100875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cf40a-1e66-474a-a166-a88c1c936254 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:47.135643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da11b6-3cd3-457d-9e7c-23ed1d2ed2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:47.136324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da11b6-3cd3-457d-9e7c-23ed1d2ed2ee None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:47.136605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da11b6-3cd3-457d-9e7c-23ed1d2ed2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:47.136879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da11b6-3cd3-457d-9e7c-23ed1d2ed2ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:47.206665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da11b6-3cd3-457d-9e7c-23ed1d2ed2ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:47.208082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da11b6-3cd3-457d-9e7c-23ed1d2ed2ee None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:47.210681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:47.322636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 581/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:47.332553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c62d1-6420-4add-961b-ee3dbb2dba18 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:47.453428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c62d1-6420-4add-961b-ee3dbb2dba18 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:47.480248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:47.490242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb79abe-aa7d-44f0-a071-69fd2233f671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:47.491120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79abe-aa7d-44f0-a071-69fd2233f671 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:47.491403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79abe-aa7d-44f0-a071-69fd2233f671 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:47.491774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb79abe-aa7d-44f0-a071-69fd2233f671 None admin] PATH_INFO: `/v3/projects/a7aaa01e0ecd412a99ae07be1c250505` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:47.492987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb79abe-aa7d-44f0-a071-69fd2233f671 None admin] RBAC: Authorizing `identity:get_project(project_id=a7aaa01e0ecd412a99ae07be1c250505)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:47.494434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb79abe-aa7d-44f0-a071-69fd2233f671 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:47.496212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 603/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:47 2022] GET /identity/v3/projects/a7aaa01e0ecd412a99ae07be1c250505 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:47.502591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da11b6-3cd3-457d-9e7c-23ed1d2ed2ee None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:47.608596 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da11b6-3cd3-457d-9e7c-23ed1d2ed2ee None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:47.610945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:47.643885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074e57a-0913-4854-a969-da4e2cacd143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:47.644554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074e57a-0913-4854-a969-da4e2cacd143 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:47.644837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074e57a-0913-4854-a969-da4e2cacd143 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:47.645104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074e57a-0913-4854-a969-da4e2cacd143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:47.645947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074e57a-0913-4854-a969-da4e2cacd143 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=a7aaa01e0ecd412a99ae07be1c250505, user.id=6ba66ae5f28e4e6d9afe478a7eeb3d7b) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:47.646252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074e57a-0913-4854-a969-da4e2cacd143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:47.647752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074e57a-0913-4854-a969-da4e2cacd143 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:47.653818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 582/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:47 2022] GET /identity/v3/role_assignments?user.id=6ba66ae5f28e4e6d9afe478a7eeb3d7b&scope.project.id=a7aaa01e0ecd412a99ae07be1c250505&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:49.726591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb5f0-59d7-447b-b42c-89d2c6f8220a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:49.727352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb5f0-59d7-447b-b42c-89d2c6f8220a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:49.727557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cb5f0-59d7-447b-b42c-89d2c6f8220a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:49.729666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 604/1186] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:49.737598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921236e-f294-4a64-a38f-5b36fe1b9cfd None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:49.738387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921236e-f294-4a64-a38f-5b36fe1b9cfd None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:49.738554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921236e-f294-4a64-a38f-5b36fe1b9cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:49.758989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d921236e-f294-4a64-a38f-5b36fe1b9cfd None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:49.760213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d921236e-f294-4a64-a38f-5b36fe1b9cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:49.840657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 583/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:49.870037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cb5f0-59d7-447b-b42c-89d2c6f8220a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:49.990011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cb5f0-59d7-447b-b42c-89d2c6f8220a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:50.025624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d30c3-48a8-4083-8d34-35618366a924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:50.026423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d30c3-48a8-4083-8d34-35618366a924 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:50.026722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d30c3-48a8-4083-8d34-35618366a924 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:50.026980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d30c3-48a8-4083-8d34-35618366a924 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:50.037448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d30c3-48a8-4083-8d34-35618366a924 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-702d30c3-48a8-4083-8d34-35618366a924 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:50.045058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:50.046317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:29:50.048006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 605/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:29:50.055494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921236e-f294-4a64-a38f-5b36fe1b9cfd None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:50.155231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:50.158963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921236e-f294-4a64-a38f-5b36fe1b9cfd None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:50.203956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:50.204769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:50.205147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:50.205494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:50.206336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:50.206697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:50.208246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:50.218070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 584/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:50.224267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d30c3-48a8-4083-8d34-35618366a924 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:50.285805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:50.340168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d30c3-48a8-4083-8d34-35618366a924 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:50.374520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8954b-26f6-42d1-91c5-72fe92e14b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:50.375382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8954b-26f6-42d1-91c5-72fe92e14b16 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:50.375696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8954b-26f6-42d1-91c5-72fe92e14b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:50.375977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8954b-26f6-42d1-91c5-72fe92e14b16 None admin] PATH_INFO: `/v3/users/6ba66ae5f28e4e6d9afe478a7eeb3d7b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:50.377162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8954b-26f6-42d1-91c5-72fe92e14b16 None admin] RBAC: Authorizing `identity:get_user(user_id=6ba66ae5f28e4e6d9afe478a7eeb3d7b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:50.378590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de8954b-26f6-42d1-91c5-72fe92e14b16 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:50.380247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 606/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:50 2022] GET /identity/v3/users/6ba66ae5f28e4e6d9afe478a7eeb3d7b => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:50.388760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:50.490481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05318ba-b7b8-42a4-8f87-30d1bb9ff4ff None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:50.529015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93552a4-0a87-4b0d-bda6-faa430d27ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:50.529858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93552a4-0a87-4b0d-bda6-faa430d27ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:50.530131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93552a4-0a87-4b0d-bda6-faa430d27ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:50.530402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93552a4-0a87-4b0d-bda6-faa430d27ea4 None admin] PATH_INFO: `/v3/projects/a7aaa01e0ecd412a99ae07be1c250505` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:50.531737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93552a4-0a87-4b0d-bda6-faa430d27ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=a7aaa01e0ecd412a99ae07be1c250505)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:50.533195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93552a4-0a87-4b0d-bda6-faa430d27ea4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:50.534878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 585/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:50 2022] GET /identity/v3/projects/a7aaa01e0ecd412a99ae07be1c250505 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:50.541821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8954b-26f6-42d1-91c5-72fe92e14b16 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:50.645029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8954b-26f6-42d1-91c5-72fe92e14b16 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:50.670316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:50.682297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d3754-966e-4fac-aa7b-141def98bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:50.683196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d3754-966e-4fac-aa7b-141def98bf1a None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:50.683471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d3754-966e-4fac-aa7b-141def98bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:50.683770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d3754-966e-4fac-aa7b-141def98bf1a None admin] PATH_INFO: `/v3/projects/a7aaa01e0ecd412a99ae07be1c250505/users/6ba66ae5f28e4e6d9afe478a7eeb3d7b/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:50.686190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d3754-966e-4fac-aa7b-141def98bf1a None admin] RBAC: Authorizing `identity:create_grant(project_id=a7aaa01e0ecd412a99ae07be1c250505, user_id=6ba66ae5f28e4e6d9afe478a7eeb3d7b, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:50.687647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d3754-966e-4fac-aa7b-141def98bf1a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:50.703228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 607/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:29:50 2022] PUT /identity/v3/projects/a7aaa01e0ecd412a99ae07be1c250505/users/6ba66ae5f28e4e6d9afe478a7eeb3d7b/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:29:52.688020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919fea7-9ca3-4f2d-9e4b-f4d6f7a796f7 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:52.688789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919fea7-9ca3-4f2d-9e4b-f4d6f7a796f7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:52.688789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3919fea7-9ca3-4f2d-9e4b-f4d6f7a796f7 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:52.690981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 586/1193] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:29:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:29:52.699513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9e80-c249-49a5-bb26-f619aee95978 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:52.699969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9e80-c249-49a5-bb26-f619aee95978 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:52.700148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f9e80-c249-49a5-bb26-f619aee95978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:52.729061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f43f9e80-c249-49a5-bb26-f619aee95978 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:29:52.730861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f43f9e80-c249-49a5-bb26-f619aee95978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:29:52.806217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 608/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:29:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:29:52.836972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919fea7-9ca3-4f2d-9e4b-f4d6f7a796f7 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:52.866232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:52.954030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3919fea7-9ca3-4f2d-9e4b-f4d6f7a796f7 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:52.989771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14998-2837-4104-b66f-21661e78ab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:52.990557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14998-2837-4104-b66f-21661e78ab78 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:52.990839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14998-2837-4104-b66f-21661e78ab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:52.991120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb14998-2837-4104-b66f-21661e78ab78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:53.001884 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb14998-2837-4104-b66f-21661e78ab78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-fbb14998-2837-4104-b66f-21661e78ab78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:29:53.009604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:29:53.010591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:29:53.011449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 587/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:29:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:29:53.017599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f9e80-c249-49a5-bb26-f619aee95978 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:53.129582 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f9e80-c249-49a5-bb26-f619aee95978 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:53.143648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:53.173891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:53.174558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:53.174847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:53.175122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:53.175910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:53.176220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:53.177586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:53.186647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 609/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:29:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:53.194424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14998-2837-4104-b66f-21661e78ab78 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:53.292362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:53.305578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb14998-2837-4104-b66f-21661e78ab78 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:53.342684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9438-07d0-4513-ba91-966df6fd6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:53.343536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9438-07d0-4513-ba91-966df6fd6005 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:53.343834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9438-07d0-4513-ba91-966df6fd6005 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:53.344081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f9438-07d0-4513-ba91-966df6fd6005 None admin] PATH_INFO: `/v3/users/6ba66ae5f28e4e6d9afe478a7eeb3d7b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:53.345396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f9438-07d0-4513-ba91-966df6fd6005 None admin] RBAC: Authorizing `identity:get_user(user_id=6ba66ae5f28e4e6d9afe478a7eeb3d7b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:53.346823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f9438-07d0-4513-ba91-966df6fd6005 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:53.348456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 588/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Tue Jul 12 13:29:53 2022] GET /identity/v3/users/6ba66ae5f28e4e6d9afe478a7eeb3d7b => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:53.354529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:53.471083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4916bd8e-df2d-453d-bd27-2ad5f03259be None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:53.505160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08b17-7d08-48d7-94e9-74d1c02cb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:53.505795 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08b17-7d08-48d7-94e9-74d1c02cb287 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:53.506072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08b17-7d08-48d7-94e9-74d1c02cb287 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:53.506343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c08b17-7d08-48d7-94e9-74d1c02cb287 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:53.549834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:53.582836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c08b17-7d08-48d7-94e9-74d1c02cb287 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:53.584333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c08b17-7d08-48d7-94e9-74d1c02cb287 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:53.688339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 610/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:29:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:29:53.694502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9438-07d0-4513-ba91-966df6fd6005 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:53.799003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f9438-07d0-4513-ba91-966df6fd6005 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:53.839576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07511b9a-4e17-4992-b4b9-ee5ee3760004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:53.840497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07511b9a-4e17-4992-b4b9-ee5ee3760004 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:53.840759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07511b9a-4e17-4992-b4b9-ee5ee3760004 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:53.841047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07511b9a-4e17-4992-b4b9-ee5ee3760004 None admin] PATH_INFO: `/v3/projects/a7aaa01e0ecd412a99ae07be1c250505` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:53.842380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07511b9a-4e17-4992-b4b9-ee5ee3760004 None admin] RBAC: Authorizing `identity:get_project(project_id=a7aaa01e0ecd412a99ae07be1c250505)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:53.843850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07511b9a-4e17-4992-b4b9-ee5ee3760004 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:53.845609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 589/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Tue Jul 12 13:29:53 2022] GET /identity/v3/projects/a7aaa01e0ecd412a99ae07be1c250505 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:29:53.855489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08b17-7d08-48d7-94e9-74d1c02cb287 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:29:53.937808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:29:53.961319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c08b17-7d08-48d7-94e9-74d1c02cb287 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:29:54.002701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db02a21a-56d3-4f81-abb7-886de3324a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:29:54.003357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02a21a-56d3-4f81-abb7-886de3324a84 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:29:54.003667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02a21a-56d3-4f81-abb7-886de3324a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:29:54.003949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db02a21a-56d3-4f81-abb7-886de3324a84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:29:54.004815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02a21a-56d3-4f81-abb7-886de3324a84 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=a7aaa01e0ecd412a99ae07be1c250505, user.id=6ba66ae5f28e4e6d9afe478a7eeb3d7b) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:29:54.005132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02a21a-56d3-4f81-abb7-886de3324a84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:29:54.006571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db02a21a-56d3-4f81-abb7-886de3324a84 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:29:54.013132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 611/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:29:53 2022] GET /identity/v3/role_assignments?user.id=6ba66ae5f28e4e6d9afe478a7eeb3d7b&scope.project.id=a7aaa01e0ecd412a99ae07be1c250505&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:03.834577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=88 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:04.010129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=30 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:49.584254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d0f7-517d-4ead-b9c8-18ad5d61d01f None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:49.585148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d0f7-517d-4ead-b9c8-18ad5d61d01f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:49.585148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463d0f7-517d-4ead-b9c8-18ad5d61d01f None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:49.586376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 590/1201] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:30:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:30:49.592754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a52b0-d7bb-463a-9974-83886e917ecc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:49.593337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a52b0-d7bb-463a-9974-83886e917ecc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:49.593337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a52b0-d7bb-463a-9974-83886e917ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:49.611777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4f0a52b0-d7bb-463a-9974-83886e917ecc None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:30:49.613115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4f0a52b0-d7bb-463a-9974-83886e917ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:30:49.710167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 612/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:30:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:30:49.736939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d0f7-517d-4ead-b9c8-18ad5d61d01f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:49.862787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463d0f7-517d-4ead-b9c8-18ad5d61d01f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:49.904790 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:49.905609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:49.905924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:49.906218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:49.919189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:49.920893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:30:49.946352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:49.948547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:49.950497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:30:49.950497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:30:49.950497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:49.950497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:30:49.950497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 591/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:49.955265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a52b0-d7bb-463a-9974-83886e917ecc None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:50.080625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a52b0-d7bb-463a-9974-83886e917ecc None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:50.114506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:50.121140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57771ce3-17e6-4930-8910-5b20aef6d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:50.124302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57771ce3-17e6-4930-8910-5b20aef6d994 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:50.124612 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57771ce3-17e6-4930-8910-5b20aef6d994 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:50.124878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57771ce3-17e6-4930-8910-5b20aef6d994 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:50.125618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57771ce3-17e6-4930-8910-5b20aef6d994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:50.125925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57771ce3-17e6-4930-8910-5b20aef6d994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:50.127344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57771ce3-17e6-4930-8910-5b20aef6d994 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:50.139989 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 613/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:30:50.145410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:50.213999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:50.268131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce393c2e-05e7-4bc8-97ff-aec20f942a55 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:50.313784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6646af6-cbd7-4731-87f4-cfc9498d22a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:50.314813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6646af6-cbd7-4731-87f4-cfc9498d22a3 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:50.315086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6646af6-cbd7-4731-87f4-cfc9498d22a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:50.315361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6646af6-cbd7-4731-87f4-cfc9498d22a3 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:50.316138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6646af6-cbd7-4731-87f4-cfc9498d22a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:50.317581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6646af6-cbd7-4731-87f4-cfc9498d22a3 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:50.339681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 592/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Tue Jul 12 13:30:50 2022] POST /identity/v3/users => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:30:52.650824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf138c-edf9-4a64-8a5e-733af697c7f8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:52.651436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf138c-edf9-4a64-8a5e-733af697c7f8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:52.651436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddf138c-edf9-4a64-8a5e-733af697c7f8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:52.653297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 614/1206] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:30:52.659068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121bded-9979-4ecf-8ac4-8cb6720ab384 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:52.659584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121bded-9979-4ecf-8ac4-8cb6720ab384 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:52.659584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e121bded-9979-4ecf-8ac4-8cb6720ab384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:52.678801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e121bded-9979-4ecf-8ac4-8cb6720ab384 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:30:52.680294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e121bded-9979-4ecf-8ac4-8cb6720ab384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:30:52.772598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 593/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:30:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:30:52.797496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf138c-edf9-4a64-8a5e-733af697c7f8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:52.923368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddf138c-edf9-4a64-8a5e-733af697c7f8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:52.962221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f050d9e-9aaf-4868-a85e-5af41f1cb15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:52.963203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050d9e-9aaf-4868-a85e-5af41f1cb15d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:52.963549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050d9e-9aaf-4868-a85e-5af41f1cb15d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:52.963853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f050d9e-9aaf-4868-a85e-5af41f1cb15d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:52.975088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f050d9e-9aaf-4868-a85e-5af41f1cb15d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-9f050d9e-9aaf-4868-a85e-5af41f1cb15d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:30:52.982824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:52.989199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:30:52.990697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 615/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:30:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:30:52.992330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121bded-9979-4ecf-8ac4-8cb6720ab384 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:53.041715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:53.111081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e121bded-9979-4ecf-8ac4-8cb6720ab384 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:53.151122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:53.151852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:53.152141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:53.152457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:53.153309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:53.153642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:53.155072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:53.164009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 594/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:30:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:53.169875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f050d9e-9aaf-4868-a85e-5af41f1cb15d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:53.227398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:53.284262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f050d9e-9aaf-4868-a85e-5af41f1cb15d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:53.321423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:53.322268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:53.322499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:53.322772 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:53.333573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:53.335059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:30:53.353120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:53.354401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:53.355502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:30:53.355502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:30:53.355502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:53.355502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:30:53.359338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 616/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:53.360318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:53.468606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:53.472028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510044cf-9ac9-4b95-ac1f-73c389dcb011 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:53.507567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:53.508499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:53.508929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:53.509350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:53.510225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:53.510678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:53.512256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:53.531626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 595/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:53.533704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:53.640922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947763d4-de6d-4cab-bbe2-c9c1e3fbff2b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:53.642701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:53.682084 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:53.683312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:53.683656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:53.684121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:53.693284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:53.694630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:30:53.710578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:53.711740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:30:53.712999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 617/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:30:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:53.718054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:53.833064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a696932-ae67-4976-bbd6-c9f8e9b177f1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:53.873002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:53.874299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:53.875095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:53.875569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:53.877017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:53.877730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:53.879761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:53.903631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 596/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 12 13:30:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:53.910440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:54.035978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4e8df-cc01-4f78-9a4a-138aeea04816 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:54.083956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442276a-1f79-4fde-9fa1-19d637d36ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:54.084542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442276a-1f79-4fde-9fa1-19d637d36ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:54.084825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442276a-1f79-4fde-9fa1-19d637d36ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:54.085101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1442276a-1f79-4fde-9fa1-19d637d36ce6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:54.129399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:54.181287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442276a-1f79-4fde-9fa1-19d637d36ce6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:54.183298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1442276a-1f79-4fde-9fa1-19d637d36ce6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:54.315093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 618/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:30:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:30:54.316765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:54.339712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:54.452621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecdff5-4a55-4467-ba64-9b3ed66d8010 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:54.493741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:54.494650 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:54.494931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:54.495200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:54.507643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:54.509150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:30:54.528567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:54.529531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:54.530439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:30:54.530439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:30:54.530439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:54.530439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:30:54.530439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 597/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:30:54.536017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442276a-1f79-4fde-9fa1-19d637d36ce6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:54.601454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:54.661873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1442276a-1f79-4fde-9fa1-19d637d36ce6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:54.701559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:54.702239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:54.702504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:54.702778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:54.703507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:54.703858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:54.705238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:54.722743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 619/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:54.723837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:54.801194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:54.838359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff239f-31b8-4093-8eff-42f02c8c4a01 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:54.874189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:54.875164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:54.875443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:54.875753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:54.885040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:54.886848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:30:54.905229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:54.906228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:54.907110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:30:54.907110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:30:54.907110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:30:54.907110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:30:54.907110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:30:54.907110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:30:54.907110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:30:54.907110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:30:54.913132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:54.913642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 598/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:30:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:55.025979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ae337-7594-4804-88b7-4dae67878a2a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:55.052630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:55.067972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a13ccb-5d20-4e45-a2fb-014deb692656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:55.068780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13ccb-5d20-4e45-a2fb-014deb692656 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:55.069128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13ccb-5d20-4e45-a2fb-014deb692656 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:55.069471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13ccb-5d20-4e45-a2fb-014deb692656 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:55.070279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a13ccb-5d20-4e45-a2fb-014deb692656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:55.070590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a13ccb-5d20-4e45-a2fb-014deb692656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:55.072060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a13ccb-5d20-4e45-a2fb-014deb692656 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:55.085350 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 620/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:30:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:55.091376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:55.215826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513a47f-d9b6-448f-889b-b462c4995148 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:55.252315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:55.259505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5705bf5b-60d5-4e3d-b18c-4e675adc674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:55.260251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bf5b-60d5-4e3d-b18c-4e675adc674e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:55.260588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bf5b-60d5-4e3d-b18c-4e675adc674e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:55.260915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5705bf5b-60d5-4e3d-b18c-4e675adc674e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:55.261707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705bf5b-60d5-4e3d-b18c-4e675adc674e None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=2d373d537efc44de9382e6c4cdaf6e55) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:55.262021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705bf5b-60d5-4e3d-b18c-4e675adc674e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:55.263686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5705bf5b-60d5-4e3d-b18c-4e675adc674e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:55.275643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 599/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:30:55 2022] GET /identity/v3/role_assignments?user.id=2d373d537efc44de9382e6c4cdaf6e55&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:57.414822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f11048-7c5e-4cee-a882-298ccd6c87a7 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:57.415475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f11048-7c5e-4cee-a882-298ccd6c87a7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:57.415475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f11048-7c5e-4cee-a882-298ccd6c87a7 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:57.417026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 621/1220] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:30:57.422974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da25e1b-ec3d-44dd-a0fd-d2131f6b5cac None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:57.423456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da25e1b-ec3d-44dd-a0fd-d2131f6b5cac None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:57.423555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da25e1b-ec3d-44dd-a0fd-d2131f6b5cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:57.443555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6da25e1b-ec3d-44dd-a0fd-d2131f6b5cac None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:30:57.445429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6da25e1b-ec3d-44dd-a0fd-d2131f6b5cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:30:57.522842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 600/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:30:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 13:30:57.545822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f11048-7c5e-4cee-a882-298ccd6c87a7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:57.664454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f11048-7c5e-4cee-a882-298ccd6c87a7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:57.700551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db8fd-fb72-4e88-b2b0-d8f02725f54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:57.701319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db8fd-fb72-4e88-b2b0-d8f02725f54d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:57.701597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db8fd-fb72-4e88-b2b0-d8f02725f54d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:57.701866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db8fd-fb72-4e88-b2b0-d8f02725f54d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:57.712554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db8fd-fb72-4e88-b2b0-d8f02725f54d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d93db8fd-fb72-4e88-b2b0-d8f02725f54d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:30:57.721317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:57.722362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:30:57.723220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:30:57.723896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 622/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:30:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:57.732269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da25e1b-ec3d-44dd-a0fd-d2131f6b5cac None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:57.838985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da25e1b-ec3d-44dd-a0fd-d2131f6b5cac None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:57.863646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:57.878619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:57.879460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:57.879787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:57.880234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:57.881152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] RBAC: Adding query filter params (name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:57.881595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:57.883816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:57.895025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 601/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:30:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:57.900930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db8fd-fb72-4e88-b2b0-d8f02725f54d None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:57.948427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:58.007144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db8fd-fb72-4e88-b2b0-d8f02725f54d None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:58.049408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:58.050218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:58.050499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:58.050776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:58.061532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:58.063310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:30:58.080323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:58.081571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:58.082475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:30:58.082475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:30:58.082475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:58.082475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:30:58.082475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 623/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:58.088297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:58.200025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a7e7b0-b1d7-4679-8537-75e439cd020c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:58.235024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:58.235779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:58.236097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:58.236374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:58.237100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:58.237408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:58.238781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:58.251073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 602/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:58.257911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:58.364800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:58.372573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd342a-36e9-4062-9a8e-38a2498bc84f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:58.411527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:58.412383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:58.412660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:58.413006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:58.421551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:58.423046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:30:58.437876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:58.439145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:30:58.440407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 624/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:30:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:58.445347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:58.497130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:58.556802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb6e7b-8b54-4550-9de7-32b03ae43f1d None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:58.591876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:58.592726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:58.593061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:58.593443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:58.594294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:58.594610 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:58.596084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:58.615502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 603/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 12 13:30:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:58.622257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:58.737383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93543-728e-44e3-90c9-7dd20306a8f0 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:58.772864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:58.773779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:58.774148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:58.774465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:58.787630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:58.788115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:30:58.806459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:58.807689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:58.808779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:30:58.808779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:30:58.808779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:30:58.808779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:30:58.808779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 625/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:58.814642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:58.932587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327fba3-9e08-4477-bb7e-eab3bd7af0d6 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:58.935515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:58.972462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:58.973510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:58.973775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:58.974118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:58.974987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:58.975294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:58.977054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:58.990855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 604/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:58.999484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:59.011632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:59.106737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b884d2-572c-480b-9508-24c2f29aee35 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:59.142369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:59.143174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:59.143453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:59.143761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:59.151049 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:59.152615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:30:59.167254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:30:59.168185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:30:59.169154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 626/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:30:59.174618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:59.285344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89ba5e2-ca84-45f7-b676-b1ce21c171c1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:59.321104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061eaf5c-2779-452f-9b10-0887ac9f064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:59.321913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eaf5c-2779-452f-9b10-0887ac9f064f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:59.322203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eaf5c-2779-452f-9b10-0887ac9f064f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:59.322479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061eaf5c-2779-452f-9b10-0887ac9f064f None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:59.323375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eaf5c-2779-452f-9b10-0887ac9f064f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:30:59.323769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eaf5c-2779-452f-9b10-0887ac9f064f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:59.325397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061eaf5c-2779-452f-9b10-0887ac9f064f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:59.342539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 605/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:30:59.343753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:30:59.421184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:30:59.462477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de44abd0-afc0-4c5c-a9f2-9a0f5fa5785a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:30:59.498923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8b1ba-9a7f-4bfc-a5b3-6b22db9e5eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:30:59.499929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b1ba-9a7f-4bfc-a5b3-6b22db9e5eab None admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:30:59.500210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b1ba-9a7f-4bfc-a5b3-6b22db9e5eab None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:30:59.500532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8b1ba-9a7f-4bfc-a5b3-6b22db9e5eab None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/2d373d537efc44de9382e6c4cdaf6e55/roles/eb1899ecc6e0420f90de62e74998ca33` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:30:59.516027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8b1ba-9a7f-4bfc-a5b3-6b22db9e5eab None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=2d373d537efc44de9382e6c4cdaf6e55, role_id=eb1899ecc6e0420f90de62e74998ca33)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:30:59.517515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8b1ba-9a7f-4bfc-a5b3-6b22db9e5eab None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:30:59.532886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 627/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:30:59 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/2d373d537efc44de9382e6c4cdaf6e55/roles/eb1899ecc6e0420f90de62e74998ca33 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:31:01.568810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1274b-b197-45a6-9f88-972b11f60312 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:01.569384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1274b-b197-45a6-9f88-972b11f60312 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:01.569384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1274b-b197-45a6-9f88-972b11f60312 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:01.570996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 606/1233] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:31:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:31:01.576488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb611-c033-4d8d-9db4-cdcb60aefeb0 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:01.576940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb611-c033-4d8d-9db4-cdcb60aefeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:01.577033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fb611-c033-4d8d-9db4-cdcb60aefeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:01.594752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-953fb611-c033-4d8d-9db4-cdcb60aefeb0 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:31:01.596342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-953fb611-c033-4d8d-9db4-cdcb60aefeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:31:01.665209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 628/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:31:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:31:01.690392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1274b-b197-45a6-9f88-972b11f60312 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:01.715959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:01.804452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1274b-b197-45a6-9f88-972b11f60312 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:01.842490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0aedf-45fc-4cb3-8fb6-520d82937d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:01.843211 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0aedf-45fc-4cb3-8fb6-520d82937d9e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:01.843497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0aedf-45fc-4cb3-8fb6-520d82937d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:01.843804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e0aedf-45fc-4cb3-8fb6-520d82937d9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:01.855500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e0aedf-45fc-4cb3-8fb6-520d82937d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-c9e0aedf-45fc-4cb3-8fb6-520d82937d9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:31:01.865584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:01.866688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:01.867544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 607/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Tue Jul 12 13:31:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:01.874005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fb611-c033-4d8d-9db4-cdcb60aefeb0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:01.924921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:01.984088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fb611-c033-4d8d-9db4-cdcb60aefeb0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:02.025739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:02.026715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:02.026990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:02.027270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:02.028107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] RBAC: Adding query filter params (name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:02.028412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:02.029819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:02.040403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 629/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Tue Jul 12 13:31:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:02.046355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0aedf-45fc-4cb3-8fb6-520d82937d9e None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:02.143190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:02.162714 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e0aedf-45fc-4cb3-8fb6-520d82937d9e None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:02.198126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:02.199181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:02.199463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:02.199767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:02.211478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:02.213216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:31:02.232137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:02.233220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:02.239015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:31:02.239015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:31:02.239015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:02.239015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:02.239015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 608/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:02.239414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:02.343514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b87d-4db8-43d5-a94d-efc11796f4db None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:02.352618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:02.378707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:02.379437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:02.379728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:02.379999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:02.380869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:02.381108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:02.382605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:02.395567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 630/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:02.402339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:02.525348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f2913-d6f9-44f3-9daa-1415df778965 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:02.562726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:02.564234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:02.564612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:02.564949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:02.568800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:02.574593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:02.576247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:31:02.591842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:02.593220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:02.594204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 609/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:02.599186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:02.713445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d64f6-bdd3-49ce-9c83-d3e96fcade0b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:02.759288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:02.760493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:02.760993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:02.761250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:02.762094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:02.762540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:02.764529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:02.784945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 631/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 12 13:31:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:02.792230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:02.897781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346206eb-6b7a-4ea5-94a2-2a5c330c99d4 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:02.936875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e4ca3-42b0-4a16-828d-cc0a6b9660a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:02.938724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e4ca3-42b0-4a16-828d-cc0a6b9660a5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:02.939008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e4ca3-42b0-4a16-828d-cc0a6b9660a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:02.939287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e4ca3-42b0-4a16-828d-cc0a6b9660a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:03.008292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:03.016117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e4ca3-42b0-4a16-828d-cc0a6b9660a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:03.017666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e4ca3-42b0-4a16-828d-cc0a6b9660a5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:03.132292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 610/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:31:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 13:31:03.138269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:03.167887 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:03.243283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5f376-8594-4f4f-ada4-9ef7df8ef33a None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:03.280863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:03.281749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:03.282072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:03.282365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:03.293777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:03.295225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:31:03.319299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:03.320333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:03.321226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:31:03.321226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:31:03.321226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:03.321226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:03.321226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 632/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:03.326784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e4ca3-42b0-4a16-828d-cc0a6b9660a5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:03.438521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:03.445886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e4ca3-42b0-4a16-828d-cc0a6b9660a5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:03.487068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:03.487813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:03.488134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:03.488436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:03.489282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:03.489618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:03.491137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:03.504374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 611/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:31:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:03.510604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:03.598359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:03.621478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e48b9-cfa5-484d-a391-60f7bf0518e3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:03.657860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:03.658807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:03.659101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:03.659406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:03.667427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:03.669048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:31:03.684453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:03.685496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:03.686384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 633/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:31:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:03.691983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:03.794146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdb3068-0efb-4dbb-8ac7-a89439cf1ac9 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:03.830308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66fe81-3787-48d2-ba02-f7296a0b649e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:03.830972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fe81-3787-48d2-ba02-f7296a0b649e None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:03.831252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fe81-3787-48d2-ba02-f7296a0b649e None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:03.831516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66fe81-3787-48d2-ba02-f7296a0b649e None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:03.832332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66fe81-3787-48d2-ba02-f7296a0b649e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:03.832647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66fe81-3787-48d2-ba02-f7296a0b649e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:03.834082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66fe81-3787-48d2-ba02-f7296a0b649e None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:03.847170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 612/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:31:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:31:03.853388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:03.961461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a7c5a-a5eb-4733-b2b3-bf8e994c7be4 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:03.997956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd1f33-a7bf-4e65-a3fb-a76b1fc2decc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:03.998596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1f33-a7bf-4e65-a3fb-a76b1fc2decc None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:03.998874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1f33-a7bf-4e65-a3fb-a76b1fc2decc None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:03.999163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1f33-a7bf-4e65-a3fb-a76b1fc2decc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:04.000009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd1f33-a7bf-4e65-a3fb-a76b1fc2decc None admin] RBAC: Adding query filter params (role.id=eb1899ecc6e0420f90de62e74998ca33, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=2d373d537efc44de9382e6c4cdaf6e55) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:04.000317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd1f33-a7bf-4e65-a3fb-a76b1fc2decc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:04.001748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd1f33-a7bf-4e65-a3fb-a76b1fc2decc None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:04.007769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 634/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:31:03 2022] GET /identity/v3/role_assignments?user.id=2d373d537efc44de9382e6c4cdaf6e55&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=eb1899ecc6e0420f90de62e74998ca33 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:06.378213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fe99-dc13-4b3c-a8d6-9d25cc5df953 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:06.378213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fe99-dc13-4b3c-a8d6-9d25cc5df953 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:06.378213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245fe99-dc13-4b3c-a8d6-9d25cc5df953 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:06.378213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 613/1247] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:31:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:31:06.384279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cef323-f339-495b-a9f6-549a08542d52 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:06.384764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cef323-f339-495b-a9f6-549a08542d52 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:06.384852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cef323-f339-495b-a9f6-549a08542d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:06.392444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:06.406562 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-39cef323-f339-495b-a9f6-549a08542d52 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:31:06.408212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-39cef323-f339-495b-a9f6-549a08542d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:31:06.485182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 635/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:31:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:31:06.508569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245fe99-dc13-4b3c-a8d6-9d25cc5df953 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:06.528333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:06.628110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245fe99-dc13-4b3c-a8d6-9d25cc5df953 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:06.668421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84649a4-b22d-4d55-888b-8429531ae7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:06.669342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84649a4-b22d-4d55-888b-8429531ae7ae None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:06.669619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84649a4-b22d-4d55-888b-8429531ae7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:06.669889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84649a4-b22d-4d55-888b-8429531ae7ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:06.682451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84649a4-b22d-4d55-888b-8429531ae7ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f84649a4-b22d-4d55-888b-8429531ae7ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:31:06.691330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:06.692361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:06.693226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 614/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:06.699695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cef323-f339-495b-a9f6-549a08542d52 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:06.806575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cef323-f339-495b-a9f6-549a08542d52 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:06.838602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:06.844780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:06.845589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:06.845871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:06.846142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:06.846909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:06.847204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:06.848611 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:06.857566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 636/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:06.864005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84649a4-b22d-4d55-888b-8429531ae7ae None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:06.957271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:06.983201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84649a4-b22d-4d55-888b-8429531ae7ae None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:07.020384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:07.021352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:07.021642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:07.021920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:07.034430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:07.036238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:31:07.054354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:07.055490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:07.056679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:31:07.056679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:31:07.056679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:07.056679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:07.056679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 615/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:31:07.062036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:07.177527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50968d81-5664-4fd5-90b5-9bf0339f24bf None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:07.217138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:07.217865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:07.218189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:07.218523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:07.219372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:07.219775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:07.221453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:07.234563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 637/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:07.241358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:07.369070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843fdf2-8032-41a4-ac1e-8356ad079627 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:07.407145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:07.416858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:07.417769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:07.418056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:07.418343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:07.434124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:07.437166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:31:07.458869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:07.460163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:07.461483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 616/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:07.467990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:07.544372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:07.597134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6a5a36-84d5-4e51-bba4-b05585d5237b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:07.634203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:07.634903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:07.635184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:07.635467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:07.636344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:07.636673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:07.638239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:07.657251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 638/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 12 13:31:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:07.662837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:07.774231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885b904-3b44-479e-9999-ed91d279c059 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:07.811777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3e441-f64d-412d-9b22-60cd5a208ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:07.812860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e441-f64d-412d-9b22-60cd5a208ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:07.813188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e441-f64d-412d-9b22-60cd5a208ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:07.813467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e441-f64d-412d-9b22-60cd5a208ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:07.870955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:07.884577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3e441-f64d-412d-9b22-60cd5a208ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:07.886075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3e441-f64d-412d-9b22-60cd5a208ff5 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:07.996079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 617/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:31:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:31:08.002307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:08.119487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abfd15-04bd-4672-92d6-068fe97ad2ee None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:08.138498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:08.165878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:08.167223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:08.167509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:08.168038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:08.180409 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:08.181869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:31:08.202363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:08.203461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:08.204610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:31:08.204610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:31:08.204610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:08.204610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:08.204610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 639/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:31:08.209779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3e441-f64d-412d-9b22-60cd5a208ff5 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:08.307407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:08.319536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3e441-f64d-412d-9b22-60cd5a208ff5 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:08.354714 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:08.355399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:08.355698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:08.356015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:08.356806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:08.357084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:08.358538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:08.370486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 618/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:08.376468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:08.483908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007400b5-2be5-486a-b3b7-0b8750c1e8a8 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:08.524393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:08.525202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:08.525520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:08.525765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:08.534925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:08.536394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:31:08.550101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:08.551278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:08.552201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 640/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:08.557272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:08.662763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d252d-c786-40cd-9d77-e659b9719c2c None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:08.698990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459b2d6-931e-40a4-8c5b-cb379dfbc0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:08.699691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459b2d6-931e-40a4-8c5b-cb379dfbc0fe None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:08.700112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459b2d6-931e-40a4-8c5b-cb379dfbc0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:08.700391 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459b2d6-931e-40a4-8c5b-cb379dfbc0fe None admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:08.701193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459b2d6-931e-40a4-8c5b-cb379dfbc0fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:08.701504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459b2d6-931e-40a4-8c5b-cb379dfbc0fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:08.702945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459b2d6-931e-40a4-8c5b-cb379dfbc0fe None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:08.715510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 619/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:31:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:08.722005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:08.749773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:08.846420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ecc0d-9131-4378-a383-bc285c876a1f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:08.878866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce9cab-d3ca-4ff5-8cdd-07482b7db057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:08.879518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9cab-d3ca-4ff5-8cdd-07482b7db057 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:08.879950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9cab-d3ca-4ff5-8cdd-07482b7db057 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:08.880230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce9cab-d3ca-4ff5-8cdd-07482b7db057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:08.881098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce9cab-d3ca-4ff5-8cdd-07482b7db057 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=2d373d537efc44de9382e6c4cdaf6e55) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:08.881464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce9cab-d3ca-4ff5-8cdd-07482b7db057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:08.882819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce9cab-d3ca-4ff5-8cdd-07482b7db057 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:08.899671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 641/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:31:08 2022] GET /identity/v3/role_assignments?user.id=2d373d537efc44de9382e6c4cdaf6e55&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:31:10.894831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3034e4-0b84-48d3-a07f-4d1c9cb5c9be None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:10.895751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3034e4-0b84-48d3-a07f-4d1c9cb5c9be None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:10.895751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3034e4-0b84-48d3-a07f-4d1c9cb5c9be None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:10.898021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 620/1261] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:31:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:31:10.904353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a83d8-1e64-474b-964c-496b59b98078 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:10.904758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a83d8-1e64-474b-964c-496b59b98078 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:10.904863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a83d8-1e64-474b-964c-496b59b98078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:10.926924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-047a83d8-1e64-474b-964c-496b59b98078 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:31:10.928173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-047a83d8-1e64-474b-964c-496b59b98078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:31:11.002752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 642/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:31:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:31:11.025089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3034e4-0b84-48d3-a07f-4d1c9cb5c9be None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:11.036142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:11.135115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3034e4-0b84-48d3-a07f-4d1c9cb5c9be None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:11.175853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f9d5d-1731-4ae4-aa27-9a2f5b8c2541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:11.176733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9d5d-1731-4ae4-aa27-9a2f5b8c2541 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:11.177119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9d5d-1731-4ae4-aa27-9a2f5b8c2541 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:11.177483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f9d5d-1731-4ae4-aa27-9a2f5b8c2541 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:11.191634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f9d5d-1731-4ae4-aa27-9a2f5b8c2541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-6e9f9d5d-1731-4ae4-aa27-9a2f5b8c2541 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:31:11.199262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:11.200294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:11.201325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 621/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:31:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:11.207164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a83d8-1e64-474b-964c-496b59b98078 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:11.226673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:11.307944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a83d8-1e64-474b-964c-496b59b98078 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:11.342949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:11.343643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:11.343916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:11.344189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:11.344933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:11.345244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:11.346607 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:11.354644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 643/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:31:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:11.361171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f9d5d-1731-4ae4-aa27-9a2f5b8c2541 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:11.440574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:11.475905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f9d5d-1731-4ae4-aa27-9a2f5b8c2541 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:11.511542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:11.512408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:11.512702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:11.512974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:11.524265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:11.525732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:31:11.543042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:11.544194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:11.545392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:31:11.545392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:31:11.545392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:11.545392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:11.545392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 622/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:11.550663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:11.636953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:11.658404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444851-50cf-4b22-9e44-6532da0c1cbe None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:11.694240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:11.694850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:11.695133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:11.695406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:11.696188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:11.696493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:11.697873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:11.709782 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 644/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:11.715970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:11.836440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559b070-10b5-417f-93b3-b45ae6310379 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:11.856606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:11.873858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:11.874666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:11.874948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:11.875221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:11.883554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:11.885019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:31:11.899496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:11.901069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:11.902231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 623/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:11.906898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:12.009201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd3812-3028-42cb-bf16-1b483f82d54b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:12.043699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:12.044390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:12.044667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:12.044941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:12.045801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:12.046116 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:12.047546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:12.056119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:12.065080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 645/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 12 13:31:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:12.071405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:12.182966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec299039-5c4d-4088-bd24-ec56a906ff66 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:12.221905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:12.223103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:12.223563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:12.224088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:12.235950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:12.237419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:31:12.255401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:12.256446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:12.257447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:31:12.257447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:31:12.257447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:12.257447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:12.257447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 624/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:12.262632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:12.366901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b701a7-f067-4e0f-bb58-c3db75e723a6 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:12.411373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:12.412313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:12.412782 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:12.413188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:12.414184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:12.414501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:12.415921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:12.427424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 646/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:12.433516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:12.469289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:12.547215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302b510-12ca-4f32-8290-0c010d311728 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:12.582427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:12.583238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:12.583524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:12.583828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:12.590759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:12.592234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:31:12.606534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:12.607553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:12.609093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 625/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:31:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:12.617969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:12.692387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:12.745947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf822-ed05-4f0e-8463-83897c2f9593 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:12.781535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7aceb7-331b-4b04-99ec-81674508c183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:12.782219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aceb7-331b-4b04-99ec-81674508c183 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:12.782503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aceb7-331b-4b04-99ec-81674508c183 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:12.782777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aceb7-331b-4b04-99ec-81674508c183 None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:12.783569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7aceb7-331b-4b04-99ec-81674508c183 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:12.783906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7aceb7-331b-4b04-99ec-81674508c183 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:12.785342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7aceb7-331b-4b04-99ec-81674508c183 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:12.800904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 647/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:31:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:12.807360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:12.902147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:12.912449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ff3087-603f-42dd-87cc-cd18e6131615 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:12.951555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e341f-84d5-4b68-b69c-8890e95beec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:12.952472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e341f-84d5-4b68-b69c-8890e95beec7 None admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:12.952745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e341f-84d5-4b68-b69c-8890e95beec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:12.953007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e341f-84d5-4b68-b69c-8890e95beec7 None admin] PATH_INFO: `/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/2d373d537efc44de9382e6c4cdaf6e55/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:12.955156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e341f-84d5-4b68-b69c-8890e95beec7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f76112e485294c4b9bf19c4ec562e81e, user_id=2d373d537efc44de9382e6c4cdaf6e55, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:12.956638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9e341f-84d5-4b68-b69c-8890e95beec7 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:12.977449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 626/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Tue Jul 12 13:31:12 2022] PUT /identity/v3/projects/f76112e485294c4b9bf19c4ec562e81e/users/2d373d537efc44de9382e6c4cdaf6e55/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:31:15.177962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428d9a3-f069-4097-9826-ec10e90e15cb None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:15.178527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428d9a3-f069-4097-9826-ec10e90e15cb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:15.178527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428d9a3-f069-4097-9826-ec10e90e15cb None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:15.179967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 648/1274] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:31:15.185602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3686-847b-4e8f-bc3e-e62d9b863dfc None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:15.186077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3686-847b-4e8f-bc3e-e62d9b863dfc None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:15.186184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3686-847b-4e8f-bc3e-e62d9b863dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:15.203843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-dece3686-847b-4e8f-bc3e-e62d9b863dfc None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:31:15.205052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-dece3686-847b-4e8f-bc3e-e62d9b863dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:31:15.275187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 627/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:31:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:31:15.299553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428d9a3-f069-4097-9826-ec10e90e15cb None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:15.422464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428d9a3-f069-4097-9826-ec10e90e15cb None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:15.441222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:15.462073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94a6b-ed4b-47ac-86f8-5db733363b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:15.462885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94a6b-ed4b-47ac-86f8-5db733363b85 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:15.463170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94a6b-ed4b-47ac-86f8-5db733363b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:15.463447 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e94a6b-ed4b-47ac-86f8-5db733363b85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:15.474739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e94a6b-ed4b-47ac-86f8-5db733363b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-13e94a6b-ed4b-47ac-86f8-5db733363b85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 13:31:15.482512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:15.483685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:15.484802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 649/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Tue Jul 12 13:31:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:15.492742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3686-847b-4e8f-bc3e-e62d9b863dfc None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:15.583948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:15.611763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3686-847b-4e8f-bc3e-e62d9b863dfc None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:15.647739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:15.648416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:15.648702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:15.648983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:15.649750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:15.650063 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:15.651466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:15.660316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 628/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Tue Jul 12 13:31:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:15.666228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94a6b-ed4b-47ac-86f8-5db733363b85 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:15.784164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e94a6b-ed4b-47ac-86f8-5db733363b85 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:15.818562 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:15.819415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:15.819735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:15.820011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:15.831083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:15.832574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:31:15.849723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:15.850803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:15.852309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:31:15.852309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:31:15.852309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:15.852309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:15.852309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 650/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 13:31:15.860398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:15.970901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35ba9d-7e85-4368-8579-89756d996794 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:16.008754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:16.009404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:16.009701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:16.009973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:16.010703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:16.011015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:16.012449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:16.024248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 629/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:16.030835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:16.080025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:16.168567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368b3d6-3b56-4d27-8eea-9b5c08f01690 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:16.204657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:16.205480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:16.205757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:16.206026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:16.213632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:16.215073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 13:31:16.235294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:16.236321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:16.237326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 651/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:16.244292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:16.248514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:16.352797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d30f9-ac4f-4717-95ae-1bde661f6202 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:16.395212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:16.395935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:16.396263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:16.396547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:16.397512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:16.397827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:16.399469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:16.420232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 630/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Tue Jul 12 13:31:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:16.427585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:16.529108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:16.539382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f551e9-9fa6-4df7-be69-4f3eec8d3d6b None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:16.572684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb2a1-a312-433a-9c22-8c091675be8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:16.573337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb2a1-a312-433a-9c22-8c091675be8f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:16.573622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb2a1-a312-433a-9c22-8c091675be8f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:16.573901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cb2a1-a312-433a-9c22-8c091675be8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:16.640905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb2a1-a312-433a-9c22-8c091675be8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:16.642319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cb2a1-a312-433a-9c22-8c091675be8f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:16.748174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:16.765509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 652/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Tue Jul 12 13:31:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 13:31:16.772062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:16.835585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:16.875036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d81347-5ff9-425c-b4ea-1f47c13f1502 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:16.911096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:16.911858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:16.912142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:16.912413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:16.922961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:16.924435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 13:31:16.942514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:16.943555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:16.944530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 13:31:16.944530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 13:31:16.944530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 13:31:16.944530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:16.944530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 631/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:16.951827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb2a1-a312-433a-9c22-8c091675be8f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:17.060529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cb2a1-a312-433a-9c22-8c091675be8f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:17.096617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:17.097272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:17.097553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:17.097853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:17.098568 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:17.098894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:17.100285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:17.111483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 653/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Tue Jul 12 13:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:17.117927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:17.234089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f665-cc1b-40e3-a195-94e9f89bb9e1 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:17.248273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:17.269996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:17.270792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:17.271076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:17.271349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:17.278191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:17.279772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 13:31:17.293425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:17.294433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: ERROR keystone.server.flask.application Jul 12 13:31:17.295592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 632/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Tue Jul 12 13:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:17.300660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:17.353076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:17.407557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b7c1d6-c38f-4e47-a8e1-c1a14f2d722f None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:17.442162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d545a-d754-40b2-ac0e-4549f4336c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:17.442812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d545a-d754-40b2-ac0e-4549f4336c1d None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:17.443090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d545a-d754-40b2-ac0e-4549f4336c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:17.443363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d545a-d754-40b2-ac0e-4549f4336c1d None admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:17.444178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d545a-d754-40b2-ac0e-4549f4336c1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:17.444481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d545a-d754-40b2-ac0e-4549f4336c1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:17.445901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d545a-d754-40b2-ac0e-4549f4336c1d None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:17.457767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 654/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Tue Jul 12 13:31:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:17.467473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:17.592804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4056e5c-63af-4d13-8fff-6fdaa5407744 None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:17.628130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43895c-e391-4c89-9f13-e64357cc79a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:17.628795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43895c-e391-4c89-9f13-e64357cc79a8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:17.629074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43895c-e391-4c89-9f13-e64357cc79a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:17.629347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43895c-e391-4c89-9f13-e64357cc79a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:17.630183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43895c-e391-4c89-9f13-e64357cc79a8 None admin] RBAC: Adding query filter params (role.id=f673c3a045e14e8eaaaca80a4c07267e, scope.project.id=f76112e485294c4b9bf19c4ec562e81e, user.id=2d373d537efc44de9382e6c4cdaf6e55) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:17.630495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43895c-e391-4c89-9f13-e64357cc79a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:17.631970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43895c-e391-4c89-9f13-e64357cc79a8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:17.638066 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 633/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Tue Jul 12 13:31:17 2022] GET /identity/v3/role_assignments?user.id=2d373d537efc44de9382e6c4cdaf6e55&scope.project.id=f76112e485294c4b9bf19c4ec562e81e&role.id=f673c3a045e14e8eaaaca80a4c07267e => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:19.678954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89326e25-19e0-4e2c-ad7e-1d48f715fca0 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:19.679444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89326e25-19e0-4e2c-ad7e-1d48f715fca0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:19.679534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89326e25-19e0-4e2c-ad7e-1d48f715fca0 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:19.680946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 655/1288] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:31:19.687341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2cd9-1d08-4e12-b78d-b681b3baa6b4 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:19.688082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2cd9-1d08-4e12-b78d-b681b3baa6b4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:19.688290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec2cd9-1d08-4e12-b78d-b681b3baa6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:19.715331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-8aec2cd9-1d08-4e12-b78d-b681b3baa6b4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:31:19.717125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8aec2cd9-1d08-4e12-b78d-b681b3baa6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:31:19.749614 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:19.788267 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 634/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:31:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:31:19.810720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89326e25-19e0-4e2c-ad7e-1d48f715fca0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:19.921442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89326e25-19e0-4e2c-ad7e-1d48f715fca0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:19.932838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:19.964966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:19.965775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:19.966056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:19.966333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:19.967001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:19.968431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:19.980650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:19.981834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:19.983066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 656/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:31:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:19.988154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2cd9-1d08-4e12-b78d-b681b3baa6b4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:20.087406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec2cd9-1d08-4e12-b78d-b681b3baa6b4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:20.124722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd58be-6552-44c9-a789-fca0ebe5fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:20.125387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd58be-6552-44c9-a789-fca0ebe5fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:20.125674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd58be-6552-44c9-a789-fca0ebe5fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:20.125944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd58be-6552-44c9-a789-fca0ebe5fbb8 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:20.126667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd58be-6552-44c9-a789-fca0ebe5fbb8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:20.126978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd58be-6552-44c9-a789-fca0ebe5fbb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:20.128371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd58be-6552-44c9-a789-fca0ebe5fbb8 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:20.133770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 635/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Tue Jul 12 13:31:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:20.140511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:20.248224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5ebbde-6cf8-44f1-9bf6-01483501b11e None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:20.292126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb8fdbd-3400-49d0-9678-67190b2bcd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:20.292805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8fdbd-3400-49d0-9678-67190b2bcd94 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:20.293090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8fdbd-3400-49d0-9678-67190b2bcd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:20.293364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb8fdbd-3400-49d0-9678-67190b2bcd94 None admin] PATH_INFO: `/v3/services` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:20.294086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8fdbd-3400-49d0-9678-67190b2bcd94 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:20.294400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8fdbd-3400-49d0-9678-67190b2bcd94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:20.295810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb8fdbd-3400-49d0-9678-67190b2bcd94 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:20.300466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 657/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Tue Jul 12 13:31:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:22.310014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952838-fedd-4105-8576-9284b0bd0fb7 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:22.310690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952838-fedd-4105-8576-9284b0bd0fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:22.310690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b952838-fedd-4105-8576-9284b0bd0fb7 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:22.312048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 636/1293] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:31:22.317775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349119c-f3c2-41c1-a3d2-da80851f8417 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:22.318213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349119c-f3c2-41c1-a3d2-da80851f8417 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:22.318312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349119c-f3c2-41c1-a3d2-da80851f8417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:22.336589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c349119c-f3c2-41c1-a3d2-da80851f8417 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:31:22.337792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c349119c-f3c2-41c1-a3d2-da80851f8417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:31:22.368709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:22.413471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 658/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:31:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:31:22.449570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952838-fedd-4105-8576-9284b0bd0fb7 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:22.483984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:22.560831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b952838-fedd-4105-8576-9284b0bd0fb7 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:22.600327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b8c47-b0d8-4150-b750-f3d714cd6a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:22.600999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b8c47-b0d8-4150-b750-f3d714cd6a23 None admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:22.601312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b8c47-b0d8-4150-b750-f3d714cd6a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:22.601591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b8c47-b0d8-4150-b750-f3d714cd6a23 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:22.602332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b8c47-b0d8-4150-b750-f3d714cd6a23 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:22.603764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b8c47-b0d8-4150-b750-f3d714cd6a23 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:22.619301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 637/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Tue Jul 12 13:31:22 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:31:24.607914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede523d-3363-4842-b752-94e32dfc9c6a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:24.608890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede523d-3363-4842-b752-94e32dfc9c6a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:24.608890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede523d-3363-4842-b752-94e32dfc9c6a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:24.610974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 659/1296] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:31:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:31:24.619741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642b9b2-a9a5-493f-8f7f-adbaf8dacf71 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:24.620146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642b9b2-a9a5-493f-8f7f-adbaf8dacf71 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:24.620349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642b9b2-a9a5-493f-8f7f-adbaf8dacf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:24.645137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f642b9b2-a9a5-493f-8f7f-adbaf8dacf71 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:31:24.646367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f642b9b2-a9a5-493f-8f7f-adbaf8dacf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:31:24.730283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 638/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:31:24 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:31:24.759650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede523d-3363-4842-b752-94e32dfc9c6a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:24.883228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede523d-3363-4842-b752-94e32dfc9c6a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:24.917872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:24.918666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:24.918940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:24.919251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:24.919998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:24.921370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:24.933452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:24.934649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:24.935913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 660/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:31:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:24.943784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642b9b2-a9a5-493f-8f7f-adbaf8dacf71 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:24.969984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:25.055173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642b9b2-a9a5-493f-8f7f-adbaf8dacf71 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:25.090508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:25.091169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:25.091451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:25.091784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:25.092493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] RBAC: Adding query filter params (name=placement) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:25.092796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:25.094172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:25.099706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 639/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Tue Jul 12 13:31:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:25.108675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:25.141058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:25.209546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb88c6-36ac-4582-983a-5661e3ae00b3 None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:25.243293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25097a3f-d769-44cc-ad25-d15f37d78b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:25.243967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097a3f-d769-44cc-ad25-d15f37d78b43 None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:25.244248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097a3f-d769-44cc-ad25-d15f37d78b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:25.244516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25097a3f-d769-44cc-ad25-d15f37d78b43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:25.245297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097a3f-d769-44cc-ad25-d15f37d78b43 None admin] RBAC: Adding query filter params (interface=public, service_id=37739dfff07f4d44a3e743d9fc69fbbf, region_id=RegionOne) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:25.245605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097a3f-d769-44cc-ad25-d15f37d78b43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:25.246952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25097a3f-d769-44cc-ad25-d15f37d78b43 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:25.252058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 661/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Tue Jul 12 13:31:25 2022] GET /identity/v3/endpoints?service_id=37739dfff07f4d44a3e743d9fc69fbbf&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:25.260991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:25.343801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:25.370925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4813c0a-b14d-4805-a417-28d8b36c3ace None admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:25.407175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c70cf6-3dc5-432a-876f-5be409ea9c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:25.407805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70cf6-3dc5-432a-876f-5be409ea9c39 None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:25.408090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70cf6-3dc5-432a-876f-5be409ea9c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:25.408365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c70cf6-3dc5-432a-876f-5be409ea9c39 None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:25.409060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70cf6-3dc5-432a-876f-5be409ea9c39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:25.410429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c70cf6-3dc5-432a-876f-5be409ea9c39 None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:25.417405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 640/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Tue Jul 12 13:31:25 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:31:27.435660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8bdb-892d-4fef-bbc1-180f00593d7e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:27.436238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8bdb-892d-4fef-bbc1-180f00593d7e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:27.436238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba8bdb-892d-4fef-bbc1-180f00593d7e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:27.438621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 662/1302] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:31:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:31:27.447357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779b6b-cb76-485b-ad12-337376e50cf0 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:27.447784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779b6b-cb76-485b-ad12-337376e50cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:27.448052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4779b6b-cb76-485b-ad12-337376e50cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:27.467123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f4779b6b-cb76-485b-ad12-337376e50cf0 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:31:27.468350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f4779b6b-cb76-485b-ad12-337376e50cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:31:27.536388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 641/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:31:27 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 13:31:27.559420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8bdb-892d-4fef-bbc1-180f00593d7e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:27.658003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:27.665488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba8bdb-892d-4fef-bbc1-180f00593d7e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:27.701596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:27.702327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:27.702599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:27.702863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:27.703513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:27.704894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 13:31:27.716783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 13:31:27.717958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application with Lock( Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self._enter() Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application return self.creator() Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application created_value = creator( Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: ERROR keystone.server.flask.application Jul 12 13:31:27.718858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 663/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Tue Jul 12 13:31:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 13:31:27.726438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4779b6b-cb76-485b-ad12-337376e50cf0 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:27.820291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:27.846506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4779b6b-cb76-485b-ad12-337376e50cf0 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:27.882954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c614f-b599-42f9-b946-1e9c12cfcc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:27.883703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c614f-b599-42f9-b946-1e9c12cfcc2f None admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:27.884028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c614f-b599-42f9-b946-1e9c12cfcc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:27.884306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c614f-b599-42f9-b946-1e9c12cfcc2f None admin] PATH_INFO: `/v3/services` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:27.885042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c614f-b599-42f9-b946-1e9c12cfcc2f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:31:27.885388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c614f-b599-42f9-b946-1e9c12cfcc2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:27.886826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c614f-b599-42f9-b946-1e9c12cfcc2f None admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:27.892800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 642/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Tue Jul 12 13:31:27 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:31:27.899755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:31:28.003984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3bde13-407c-4ab7-a5ba-7a8fb4a302fb None admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:31:28.042545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35cfb-2ec5-4ec6-b002-367a9649a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:31:28.043196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35cfb-2ec5-4ec6-b002-367a9649a0d7 None admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:31:28.043473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35cfb-2ec5-4ec6-b002-367a9649a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:31:28.043780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35cfb-2ec5-4ec6-b002-367a9649a0d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:31:28.044523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b35cfb-2ec5-4ec6-b002-367a9649a0d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:31:28.045939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b35cfb-2ec5-4ec6-b002-367a9649a0d7 None admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:31:28.066272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 664/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Tue Jul 12 13:31:27 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:31:37.889661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=30 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:31:38.061285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:30.804039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44dca-d15f-41d7-bb2c-0c1a94ccb098 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:30.804626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44dca-d15f-41d7-bb2c-0c1a94ccb098 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:30.804626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb44dca-d15f-41d7-bb2c-0c1a94ccb098 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:30.805984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 643/1307] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:30.811343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105519c-89d0-4368-9282-4fc0d56374f5 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:30.811862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105519c-89d0-4368-9282-4fc0d56374f5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:30.811945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105519c-89d0-4368-9282-4fc0d56374f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:30.901297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2105519c-89d0-4368-9282-4fc0d56374f5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:30.902439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2105519c-89d0-4368-9282-4fc0d56374f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:31.100085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 665/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:31.184351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ea7c-85b8-4246-afbc-911fe5948049 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:31.184640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ea7c-85b8-4246-afbc-911fe5948049 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:31.184917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4ea7c-85b8-4246-afbc-911fe5948049 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:31.186451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 644/1309] 10.222.0.64 () {54 vars in 964 bytes} [Tue Jul 12 13:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:31.200359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c6e4-c3ff-4653-9565-eecabc87753e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:31.200698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c6e4-c3ff-4653-9565-eecabc87753e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:31.201007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77c6e4-c3ff-4653-9565-eecabc87753e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:31.304521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-af77c6e4-c3ff-4653-9565-eecabc87753e None None] MFA Rules not processed for user `bcdda7fcb39248c1a5a36ee699d23c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:31.305841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-af77c6e4-c3ff-4653-9565-eecabc87753e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:31.328820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:31.388500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 666/1310] 10.222.0.64 () {58 vars in 1061 bytes} [Tue Jul 12 13:32:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:31.398101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4ea7c-85b8-4246-afbc-911fe5948049 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:31.401011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-66f4ea7c-85b8-4246-afbc-911fe5948049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:31.527710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4ea7c-85b8-4246-afbc-911fe5948049 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:31.609737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472f7d3-454f-4cce-a0d9-557d1ac8594b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:31.610412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472f7d3-454f-4cce-a0d9-557d1ac8594b service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:31.610696 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472f7d3-454f-4cce-a0d9-557d1ac8594b service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:31.610971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472f7d3-454f-4cce-a0d9-557d1ac8594b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:31.612698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0472f7d3-454f-4cce-a0d9-557d1ac8594b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:31.677029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:31.738318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472f7d3-454f-4cce-a0d9-557d1ac8594b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:31.739852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472f7d3-454f-4cce-a0d9-557d1ac8594b service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:31.759263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 645/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:34.093629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59d3a-6ad2-461e-957b-c1ff652f17cf None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:34.094163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59d3a-6ad2-461e-957b-c1ff652f17cf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:34.094412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c59d3a-6ad2-461e-957b-c1ff652f17cf None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:34.095838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 667/1312] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:34.101634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c39c-12a2-4079-96e3-ea006029ae47 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:34.102261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c39c-12a2-4079-96e3-ea006029ae47 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:34.102261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76c39c-12a2-4079-96e3-ea006029ae47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:34.183046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5b76c39c-12a2-4079-96e3-ea006029ae47 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:34.184334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5b76c39c-12a2-4079-96e3-ea006029ae47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:34.294100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 646/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:34.333892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c59d3a-6ad2-461e-957b-c1ff652f17cf None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:34.335571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-67c59d3a-6ad2-461e-957b-c1ff652f17cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:34.447258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c59d3a-6ad2-461e-957b-c1ff652f17cf None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:34.523963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:34.527393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc1219-a1ef-4717-9b63-957c1e69b8ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:34.528480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc1219-a1ef-4717-9b63-957c1e69b8ab service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:34.528972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc1219-a1ef-4717-9b63-957c1e69b8ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:34.529509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc1219-a1ef-4717-9b63-957c1e69b8ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:34.531428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dadc1219-a1ef-4717-9b63-957c1e69b8ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:34.651837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc1219-a1ef-4717-9b63-957c1e69b8ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:34.654066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc1219-a1ef-4717-9b63-957c1e69b8ab service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:34.675975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 668/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:37.100894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c724e6-22c4-4e8e-981d-256751600100 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:37.101800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c724e6-22c4-4e8e-981d-256751600100 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:37.101800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c724e6-22c4-4e8e-981d-256751600100 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:37.103963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 647/1315] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:37.112553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3581-a391-43cf-8a28-19d38dc019ca None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:37.112980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3581-a391-43cf-8a28-19d38dc019ca None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:37.113224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a3581-a391-43cf-8a28-19d38dc019ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:37.192993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2d7a3581-a391-43cf-8a28-19d38dc019ca None None] MFA Rules not processed for user `02db338388904076b43d2e14f2c60417`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:37.194220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2d7a3581-a391-43cf-8a28-19d38dc019ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:37.250030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:37.309641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 669/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:37 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:37.349760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c724e6-22c4-4e8e-981d-256751600100 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:37.352209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-05c724e6-22c4-4e8e-981d-256751600100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:37.366788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:37.469194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c724e6-22c4-4e8e-981d-256751600100 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:37.552589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1659d33-5e0a-4f30-8997-1b1d92905934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:37.553381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659d33-5e0a-4f30-8997-1b1d92905934 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:37.553475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659d33-5e0a-4f30-8997-1b1d92905934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:37.553731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1659d33-5e0a-4f30-8997-1b1d92905934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:37.556106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b1659d33-5e0a-4f30-8997-1b1d92905934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:37.622834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:37.672765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659d33-5e0a-4f30-8997-1b1d92905934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:37.674230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1659d33-5e0a-4f30-8997-1b1d92905934 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:37.692750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 648/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:40.217395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7c2c-7958-4dec-b6d7-84700ab0c9db None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:40.218307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7c2c-7958-4dec-b6d7-84700ab0c9db None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:40.218307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7c2c-7958-4dec-b6d7-84700ab0c9db None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:40.220505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 670/1318] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:40.226852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890601b6-7569-4858-9116-c09c4fda749b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:40.227266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890601b6-7569-4858-9116-c09c4fda749b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:40.227405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890601b6-7569-4858-9116-c09c4fda749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:40.297178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-890601b6-7569-4858-9116-c09c4fda749b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:40.298372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-890601b6-7569-4858-9116-c09c4fda749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:40.402156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 649/1319] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:40.440980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7c2c-7958-4dec-b6d7-84700ab0c9db None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:40.443497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-078f7c2c-7958-4dec-b6d7-84700ab0c9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:40.577884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7c2c-7958-4dec-b6d7-84700ab0c9db None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:40.653056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac1700e-fc3c-42bf-9ebd-e3f71386a451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:40.653714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1700e-fc3c-42bf-9ebd-e3f71386a451 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:40.653998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1700e-fc3c-42bf-9ebd-e3f71386a451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:40.654269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac1700e-fc3c-42bf-9ebd-e3f71386a451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:40.655968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dac1700e-fc3c-42bf-9ebd-e3f71386a451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:40.663846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:40.782513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1700e-fc3c-42bf-9ebd-e3f71386a451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:40.783988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac1700e-fc3c-42bf-9ebd-e3f71386a451 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:40.802105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 671/1320] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:43.489037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e18d5b-4735-4758-869f-5f9f0a32dcba None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:43.489644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e18d5b-4735-4758-869f-5f9f0a32dcba None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:43.489644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e18d5b-4735-4758-869f-5f9f0a32dcba None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:43.490985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 650/1321] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:43.496348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c03f2d-36a7-40ec-8404-d87e894d212c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:43.496771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c03f2d-36a7-40ec-8404-d87e894d212c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:43.497016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c03f2d-36a7-40ec-8404-d87e894d212c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:43.565372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-22c03f2d-36a7-40ec-8404-d87e894d212c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:43.566577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-22c03f2d-36a7-40ec-8404-d87e894d212c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:43.624585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:43.674672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 672/1322] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:43.724187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcecd20-d443-4843-b10c-f56179871aff None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:43.724595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcecd20-d443-4843-b10c-f56179871aff None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:43.724881 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcecd20-d443-4843-b10c-f56179871aff None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:43.726331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 651/1323] 10.222.0.64 () {54 vars in 964 bytes} [Tue Jul 12 13:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:43.732927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820aced-5768-4db4-993f-1a8e44e1fc5f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:43.733215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820aced-5768-4db4-993f-1a8e44e1fc5f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:43.733486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a820aced-5768-4db4-993f-1a8e44e1fc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:43.820186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a820aced-5768-4db4-993f-1a8e44e1fc5f None None] MFA Rules not processed for user `bcdda7fcb39248c1a5a36ee699d23c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:43.821408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a820aced-5768-4db4-993f-1a8e44e1fc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:43.899145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 673/1324] 10.222.0.64 () {58 vars in 1061 bytes} [Tue Jul 12 13:32:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:43.908364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcecd20-d443-4843-b10c-f56179871aff None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:43.909891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8bcecd20-d443-4843-b10c-f56179871aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:43.929725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:44.016610 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcecd20-d443-4843-b10c-f56179871aff None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:44.091854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e83cb-6418-4210-bb48-2da2cda33330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:44.092501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e83cb-6418-4210-bb48-2da2cda33330 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:44.092778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e83cb-6418-4210-bb48-2da2cda33330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:44.093047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e83cb-6418-4210-bb48-2da2cda33330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:44.094686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-488e83cb-6418-4210-bb48-2da2cda33330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:44.168284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:44.205940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e83cb-6418-4210-bb48-2da2cda33330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:44.207460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e83cb-6418-4210-bb48-2da2cda33330 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:44.225504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 652/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:46.473947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f56f-900a-4230-b17a-11c819e6a71b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:46.474504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f56f-900a-4230-b17a-11c819e6a71b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:46.474504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f53f56f-900a-4230-b17a-11c819e6a71b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:46.475918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 674/1326] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:46.481717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097043-ce83-467f-adb4-8f465f43680d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:46.482273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097043-ce83-467f-adb4-8f465f43680d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:46.482273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097043-ce83-467f-adb4-8f465f43680d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:46.551969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-77097043-ce83-467f-adb4-8f465f43680d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:46.553201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-77097043-ce83-467f-adb4-8f465f43680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:46.659847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 653/1327] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:46.695860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f56f-900a-4230-b17a-11c819e6a71b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:46.697418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9f53f56f-900a-4230-b17a-11c819e6a71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:46.758768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:46.801785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f53f56f-900a-4230-b17a-11c819e6a71b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:46.877198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a46c3-e45f-42c3-93d6-61000bc2fdfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:46.877858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a46c3-e45f-42c3-93d6-61000bc2fdfe service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:46.878140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a46c3-e45f-42c3-93d6-61000bc2fdfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:46.878412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a46c3-e45f-42c3-93d6-61000bc2fdfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:46.880236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d01a46c3-e45f-42c3-93d6-61000bc2fdfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:46.989105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:46.991246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a46c3-e45f-42c3-93d6-61000bc2fdfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:46.992988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a46c3-e45f-42c3-93d6-61000bc2fdfe service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:47.011511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 675/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:49.086121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea85db-e19b-461c-b49b-19f9039330c2 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:49.086591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea85db-e19b-461c-b49b-19f9039330c2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:49.086685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea85db-e19b-461c-b49b-19f9039330c2 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:49.088116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 654/1329] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:49.093391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f1d2-1bd0-4be4-b0a4-f47abdfe55ca None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:49.093820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f1d2-1bd0-4be4-b0a4-f47abdfe55ca None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:49.093998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f1d2-1bd0-4be4-b0a4-f47abdfe55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:49.158233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f297f1d2-1bd0-4be4-b0a4-f47abdfe55ca None None] MFA Rules not processed for user `02db338388904076b43d2e14f2c60417`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:49.159461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f297f1d2-1bd0-4be4-b0a4-f47abdfe55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:49.279642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 676/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:49.317340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea85db-e19b-461c-b49b-19f9039330c2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:49.318980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2fea85db-e19b-461c-b49b-19f9039330c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:49.353298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:49.431816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea85db-e19b-461c-b49b-19f9039330c2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:49.510477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c3dba-2fed-4254-a672-0d3fd77461cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:49.511059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c3dba-2fed-4254-a672-0d3fd77461cb service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:49.511345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c3dba-2fed-4254-a672-0d3fd77461cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:49.511687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c3dba-2fed-4254-a672-0d3fd77461cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:49.513360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7a2c3dba-2fed-4254-a672-0d3fd77461cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:49.612210 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:49.647114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c3dba-2fed-4254-a672-0d3fd77461cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:49.648610 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c3dba-2fed-4254-a672-0d3fd77461cb service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:49.668374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 655/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:52.113734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523240-dc47-453c-af7e-1a0eb7f69cf5 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:52.114304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523240-dc47-453c-af7e-1a0eb7f69cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:52.114304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523240-dc47-453c-af7e-1a0eb7f69cf5 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:52.115634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 677/1332] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:52.121983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29b24-ab5b-437e-82ed-27a57efd024e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:52.122441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29b24-ab5b-437e-82ed-27a57efd024e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:52.122548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29b24-ab5b-437e-82ed-27a57efd024e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:52.204873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-85d29b24-ab5b-437e-82ed-27a57efd024e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:52.206193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-85d29b24-ab5b-437e-82ed-27a57efd024e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:52.308243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 656/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:52.347819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523240-dc47-453c-af7e-1a0eb7f69cf5 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:52.350378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bd523240-dc47-453c-af7e-1a0eb7f69cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:52.429808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:52.470038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523240-dc47-453c-af7e-1a0eb7f69cf5 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:52.549915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6c09a-5492-4f3d-82cb-287207c31d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:52.551077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c09a-5492-4f3d-82cb-287207c31d88 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:52.551365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c09a-5492-4f3d-82cb-287207c31d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:52.551678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6c09a-5492-4f3d-82cb-287207c31d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:52.553375 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1ff6c09a-5492-4f3d-82cb-287207c31d88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:52.676420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6c09a-5492-4f3d-82cb-287207c31d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:52.677869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6c09a-5492-4f3d-82cb-287207c31d88 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:52.687733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:52.698449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 678/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:54.772359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0515f49-0028-445e-8784-206ab9e4c1dd None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:54.773013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0515f49-0028-445e-8784-206ab9e4c1dd None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:54.773013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0515f49-0028-445e-8784-206ab9e4c1dd None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:54.774358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 657/1335] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:54.780812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f296-fcb4-443c-95e5-72ed17160303 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:54.781278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f296-fcb4-443c-95e5-72ed17160303 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:54.781386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f296-fcb4-443c-95e5-72ed17160303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:54.864553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e282f296-fcb4-443c-95e5-72ed17160303 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:54.865766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e282f296-fcb4-443c-95e5-72ed17160303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:54.967336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 679/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:55.010391 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0515f49-0028-445e-8784-206ab9e4c1dd None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:55.013225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e0515f49-0028-445e-8784-206ab9e4c1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:55.065164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:55.132561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0515f49-0028-445e-8784-206ab9e4c1dd None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:55.212375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c3328-87d1-45c3-8402-915e0b5f7508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:55.213024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3328-87d1-45c3-8402-915e0b5f7508 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:55.213300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3328-87d1-45c3-8402-915e0b5f7508 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:55.213569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c3328-87d1-45c3-8402-915e0b5f7508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:55.215207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5a4c3328-87d1-45c3-8402-915e0b5f7508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:55.310515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:55.346462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c3328-87d1-45c3-8402-915e0b5f7508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:55.348043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c3328-87d1-45c3-8402-915e0b5f7508 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:55.368720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 658/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:32:57.840443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735dbd-eaa1-4f6d-b985-d5e8565e5341 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:57.841036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735dbd-eaa1-4f6d-b985-d5e8565e5341 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:57.841036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33735dbd-eaa1-4f6d-b985-d5e8565e5341 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:57.842428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 680/1338] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:32:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:32:57.848922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d672bc-551e-40ec-8a2b-dc4e5dffceaf None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:57.849618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d672bc-551e-40ec-8a2b-dc4e5dffceaf None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:57.849798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d672bc-551e-40ec-8a2b-dc4e5dffceaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:57.921707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-89d672bc-551e-40ec-8a2b-dc4e5dffceaf None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:32:57.922823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-89d672bc-551e-40ec-8a2b-dc4e5dffceaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:58.025716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 659/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:32:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:32:58.061988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735dbd-eaa1-4f6d-b985-d5e8565e5341 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:32:58.063576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-33735dbd-eaa1-4f6d-b985-d5e8565e5341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:58.152656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:32:58.186340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33735dbd-eaa1-4f6d-b985-d5e8565e5341 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:32:58.274071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0040e-49c3-4f8e-adbc-2a48d40cc554 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:32:58.274719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0040e-49c3-4f8e-adbc-2a48d40cc554 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:32:58.274996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0040e-49c3-4f8e-adbc-2a48d40cc554 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:32:58.275567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0040e-49c3-4f8e-adbc-2a48d40cc554 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:32:58.277297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-61e0040e-49c3-4f8e-adbc-2a48d40cc554 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:32:58.396265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0040e-49c3-4f8e-adbc-2a48d40cc554 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:32:58.398111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0040e-49c3-4f8e-adbc-2a48d40cc554 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:32:58.418074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 681/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:32:58 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:02.400196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949e85-ed3c-4897-ae01-92a880cfa383 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:02.400722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949e85-ed3c-4897-ae01-92a880cfa383 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:02.400722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76949e85-ed3c-4897-ae01-92a880cfa383 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:02.402104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 660/1341] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:02.407524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554b9d-0a0f-49cd-8f56-202c0f95471e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:02.408119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554b9d-0a0f-49cd-8f56-202c0f95471e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:02.408119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d554b9d-0a0f-49cd-8f56-202c0f95471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:02.412624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:02.476091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3d554b9d-0a0f-49cd-8f56-202c0f95471e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:02.477317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3d554b9d-0a0f-49cd-8f56-202c0f95471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:02.582480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 682/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:02.620883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949e85-ed3c-4897-ae01-92a880cfa383 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:02.622514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-76949e85-ed3c-4897-ae01-92a880cfa383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:02.673966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:02.729351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76949e85-ed3c-4897-ae01-92a880cfa383 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:02.803279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5df1e1-f1b9-49d8-81cc-450a41fe19d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:02.803966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5df1e1-f1b9-49d8-81cc-450a41fe19d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:02.804243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5df1e1-f1b9-49d8-81cc-450a41fe19d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:02.804473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5df1e1-f1b9-49d8-81cc-450a41fe19d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:02.806127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0f5df1e1-f1b9-49d8-81cc-450a41fe19d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:02.901452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:02.918594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5df1e1-f1b9-49d8-81cc-450a41fe19d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:02.920010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5df1e1-f1b9-49d8-81cc-450a41fe19d6 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:02.940080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 661/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:05.539197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefbfe0-4d06-4a6d-9bf9-85f16debbb4c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:05.539924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefbfe0-4d06-4a6d-9bf9-85f16debbb4c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:05.539924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cefbfe0-4d06-4a6d-9bf9-85f16debbb4c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:05.541295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 683/1344] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:05.548355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8785-3549-4ee4-a59a-dec76ca194db None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:05.548821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8785-3549-4ee4-a59a-dec76ca194db None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:05.549004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b8785-3549-4ee4-a59a-dec76ca194db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:05.622416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6c6b8785-3549-4ee4-a59a-dec76ca194db None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:05.623664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6c6b8785-3549-4ee4-a59a-dec76ca194db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:05.744045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 662/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:05 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:05.781079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefbfe0-4d06-4a6d-9bf9-85f16debbb4c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:05.782637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4cefbfe0-4d06-4a6d-9bf9-85f16debbb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:05.872663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:05.894171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cefbfe0-4d06-4a6d-9bf9-85f16debbb4c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:05.968430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3e72d-5278-4bf3-94c4-a1845bc6258a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:05.969086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e72d-5278-4bf3-94c4-a1845bc6258a service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:05.969367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e72d-5278-4bf3-94c4-a1845bc6258a service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:05.969642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e72d-5278-4bf3-94c4-a1845bc6258a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:05.971299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-07c3e72d-5278-4bf3-94c4-a1845bc6258a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:06.084958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3e72d-5278-4bf3-94c4-a1845bc6258a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:06.086305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3e72d-5278-4bf3-94c4-a1845bc6258a service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:06.104963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 684/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:10.164363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39099e-7142-4cab-ae4b-75540e4bf83c None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:10.164944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39099e-7142-4cab-ae4b-75540e4bf83c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:10.164944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af39099e-7142-4cab-ae4b-75540e4bf83c None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:10.166220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 663/1347] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:10.171881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c23e-1474-48f4-86cc-d9d5be6d0e5e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:10.172339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c23e-1474-48f4-86cc-d9d5be6d0e5e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:10.172431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07c23e-1474-48f4-86cc-d9d5be6d0e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:10.187349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:10.245099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-be07c23e-1474-48f4-86cc-d9d5be6d0e5e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:10.246347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-be07c23e-1474-48f4-86cc-d9d5be6d0e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:10.369333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 685/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:10.407842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39099e-7142-4cab-ae4b-75540e4bf83c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:10.409616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-af39099e-7142-4cab-ae4b-75540e4bf83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:10.471400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:10.521410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af39099e-7142-4cab-ae4b-75540e4bf83c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:10.604597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0c9ec2-c7b8-4df9-9142-01db0c6376f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:10.605411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c9ec2-c7b8-4df9-9142-01db0c6376f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:10.605859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c9ec2-c7b8-4df9-9142-01db0c6376f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:10.606231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0c9ec2-c7b8-4df9-9142-01db0c6376f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:10.608563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4d0c9ec2-c7b8-4df9-9142-01db0c6376f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:10.738349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:10.742480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c9ec2-c7b8-4df9-9142-01db0c6376f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:10.744151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0c9ec2-c7b8-4df9-9142-01db0c6376f5 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:10.765948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 664/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:15.794874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e9d4-4c6c-41fc-a690-0f18557d672e None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:15.795391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e9d4-4c6c-41fc-a690-0f18557d672e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:15.795765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8e9d4-4c6c-41fc-a690-0f18557d672e None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:15.797432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 686/1350] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:15.802368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617de06-06bc-4d19-8641-c6c787b0a852 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:15.802810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617de06-06bc-4d19-8641-c6c787b0a852 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:15.802920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617de06-06bc-4d19-8641-c6c787b0a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:15.889708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0617de06-06bc-4d19-8641-c6c787b0a852 None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:15.891308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0617de06-06bc-4d19-8641-c6c787b0a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:16.017651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 665/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:33:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:20.140911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059cc0-0234-4c6c-beaf-299b3eb83ace None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:20.141891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059cc0-0234-4c6c-beaf-299b3eb83ace None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:20.142141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059cc0-0234-4c6c-beaf-299b3eb83ace None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:20.143762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 687/1352] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:20.149018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110205a1-3d24-4210-9d9a-93b3f3aa8c17 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:20.149480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110205a1-3d24-4210-9d9a-93b3f3aa8c17 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:20.149626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110205a1-3d24-4210-9d9a-93b3f3aa8c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:20.206635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:20.231783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-110205a1-3d24-4210-9d9a-93b3f3aa8c17 None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:20.233012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-110205a1-3d24-4210-9d9a-93b3f3aa8c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:20.356576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 666/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:33:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:20.367056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=59 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:21.647737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2d74-f231-4572-994a-73e9f4972526 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:21.648408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2d74-f231-4572-994a-73e9f4972526 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:21.648408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c2d74-f231-4572-994a-73e9f4972526 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:21.649737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 688/1354] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:21.655631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f254-fc5d-4359-8403-189e5dced3c0 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:21.656072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f254-fc5d-4359-8403-189e5dced3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:21.656187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f598f254-fc5d-4359-8403-189e5dced3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:21.733797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f598f254-fc5d-4359-8403-189e5dced3c0 None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:21.735018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f598f254-fc5d-4359-8403-189e5dced3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:21.778590 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:21.843914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 667/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:33:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:25.271585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323db3-6ef9-445a-b9da-fcc636cd6f3c None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:25.272551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323db3-6ef9-445a-b9da-fcc636cd6f3c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:25.272996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22323db3-6ef9-445a-b9da-fcc636cd6f3c None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:25.279013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 689/1356] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:25.280701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c9ee-41f6-4562-b6a2-f964a15652f7 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:25.281518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c9ee-41f6-4562-b6a2-f964a15652f7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:25.281797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406c9ee-41f6-4562-b6a2-f964a15652f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:25.362301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7406c9ee-41f6-4562-b6a2-f964a15652f7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:25.363921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7406c9ee-41f6-4562-b6a2-f964a15652f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:25.472120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 668/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:25.524536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9a952-ad86-4eac-b41d-4a85a6c2fbf3 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:25.524815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9a952-ad86-4eac-b41d-4a85a6c2fbf3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:25.525276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9a952-ad86-4eac-b41d-4a85a6c2fbf3 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:25.526838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 690/1358] 10.222.0.64 () {54 vars in 961 bytes} [Tue Jul 12 13:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:25.536787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39fc68-1978-4419-b205-a062ae55419b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:25.537204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39fc68-1978-4419-b205-a062ae55419b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:25.537733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39fc68-1978-4419-b205-a062ae55419b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:25.557316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:25.623081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-eb39fc68-1978-4419-b205-a062ae55419b None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:25.624262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-eb39fc68-1978-4419-b205-a062ae55419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:25.753772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 669/1359] 10.222.0.64 () {58 vars in 1058 bytes} [Tue Jul 12 13:33:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:25.762399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9a952-ad86-4eac-b41d-4a85a6c2fbf3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:25.763976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-47a9a952-ad86-4eac-b41d-4a85a6c2fbf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:25.922575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9a952-ad86-4eac-b41d-4a85a6c2fbf3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:26.003463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:26.046439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7e13d-894b-466b-9cbb-8196c13f4a10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:26.046980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e13d-894b-466b-9cbb-8196c13f4a10 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:26.047263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e13d-894b-466b-9cbb-8196c13f4a10 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:26.047539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7e13d-894b-466b-9cbb-8196c13f4a10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:26.049224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f0e7e13d-894b-466b-9cbb-8196c13f4a10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:26.143794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e13d-894b-466b-9cbb-8196c13f4a10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:26.145415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7e13d-894b-466b-9cbb-8196c13f4a10 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:26.164644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 691/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:28.392955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706e4a-b05a-48a2-8715-9251789d4322 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:28.393512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706e4a-b05a-48a2-8715-9251789d4322 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:28.393512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7706e4a-b05a-48a2-8715-9251789d4322 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:28.395082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 670/1361] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:28.400636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c089d-b972-40df-bc59-7bbe1248b42a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:28.401117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c089d-b972-40df-bc59-7bbe1248b42a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:28.401437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c089d-b972-40df-bc59-7bbe1248b42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:28.474705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bb0c089d-b972-40df-bc59-7bbe1248b42a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:28.476153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bb0c089d-b972-40df-bc59-7bbe1248b42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:28.518940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:28.603652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 692/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:28.646899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7706e4a-b05a-48a2-8715-9251789d4322 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:28.648805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e7706e4a-b05a-48a2-8715-9251789d4322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:28.719660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:28.806928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7706e4a-b05a-48a2-8715-9251789d4322 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:28.924142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faacff29-0b5e-4434-81cb-c4047035878c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:28.924799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacff29-0b5e-4434-81cb-c4047035878c service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:28.925077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacff29-0b5e-4434-81cb-c4047035878c service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:28.925448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faacff29-0b5e-4434-81cb-c4047035878c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:28.927221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-faacff29-0b5e-4434-81cb-c4047035878c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:28.952972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:29.023826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacff29-0b5e-4434-81cb-c4047035878c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:29.025720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faacff29-0b5e-4434-81cb-c4047035878c service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:29.049204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 671/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:31.416955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0bcf-da35-4f14-a7b3-b9e9d949c1ef None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:31.417530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0bcf-da35-4f14-a7b3-b9e9d949c1ef None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:31.417530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0bcf-da35-4f14-a7b3-b9e9d949c1ef None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:31.419170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 693/1364] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:31.424472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30e012-6178-401d-b9f3-153ef40aa3e5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:31.424905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30e012-6178-401d-b9f3-153ef40aa3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:31.425100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30e012-6178-401d-b9f3-153ef40aa3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:31.505238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-fb30e012-6178-401d-b9f3-153ef40aa3e5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:31.506428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fb30e012-6178-401d-b9f3-153ef40aa3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:31.617165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:31.626694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 672/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:31.668835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce816-3466-4f84-9042-77e834f3f3e4 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:31.669195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce816-3466-4f84-9042-77e834f3f3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:31.669540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bce816-3466-4f84-9042-77e834f3f3e4 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:31.671042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 694/1366] 10.222.0.64 () {54 vars in 961 bytes} [Tue Jul 12 13:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:31.676970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1225b-1ae3-4b65-a08e-e7e5a4e81ae9 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:31.677352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1225b-1ae3-4b65-a08e-e7e5a4e81ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:31.677815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1225b-1ae3-4b65-a08e-e7e5a4e81ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:31.763375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1db1225b-1ae3-4b65-a08e-e7e5a4e81ae9 None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:31.764619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1db1225b-1ae3-4b65-a08e-e7e5a4e81ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:31.891693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 673/1367] 10.222.0.64 () {58 vars in 1058 bytes} [Tue Jul 12 13:33:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:31.897212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bce816-3466-4f84-9042-77e834f3f3e4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:31.898947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a0bce816-3466-4f84-9042-77e834f3f3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:32.057185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bce816-3466-4f84-9042-77e834f3f3e4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:32.079626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:32.180539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415d6488-4645-4a78-a3b3-524a4902dd7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:32.181203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d6488-4645-4a78-a3b3-524a4902dd7f service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:32.181470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d6488-4645-4a78-a3b3-524a4902dd7f service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:32.181743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415d6488-4645-4a78-a3b3-524a4902dd7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:32.183420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-415d6488-4645-4a78-a3b3-524a4902dd7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:32.277277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d6488-4645-4a78-a3b3-524a4902dd7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:32.278977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415d6488-4645-4a78-a3b3-524a4902dd7f service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:32.298291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 695/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:33.296649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e4d37-2077-4617-8419-bce567efe62c None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:33.297222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e4d37-2077-4617-8419-bce567efe62c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:33.297222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e4d37-2077-4617-8419-bce567efe62c None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:33.298667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 674/1369] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:33.303937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c14da-e618-40e2-8ffe-40b966d7e4f0 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:33.304378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c14da-e618-40e2-8ffe-40b966d7e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:33.304667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9c14da-e618-40e2-8ffe-40b966d7e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:33.338040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:33.376994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5c9c14da-e618-40e2-8ffe-40b966d7e4f0 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:33.378401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5c9c14da-e618-40e2-8ffe-40b966d7e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:33.483639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 696/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:33.840763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962badf-caa8-4b7a-902f-0c6cee2ad9c8 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:33.841224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962badf-caa8-4b7a-902f-0c6cee2ad9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:33.841542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962badf-caa8-4b7a-902f-0c6cee2ad9c8 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:33.843454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 675/1371] 10.222.0.64 () {54 vars in 963 bytes} [Tue Jul 12 13:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:33.848241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255129-99be-47bd-a341-92a80990b9dd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:33.848653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255129-99be-47bd-a341-92a80990b9dd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:33.849024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb255129-99be-47bd-a341-92a80990b9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:33.929693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-fb255129-99be-47bd-a341-92a80990b9dd None None] MFA Rules not processed for user `1df6ff57287645b2ae6f3b68543d6fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:33.931050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fb255129-99be-47bd-a341-92a80990b9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:33.982477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:34.014988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 697/1372] 10.222.0.64 () {58 vars in 1060 bytes} [Tue Jul 12 13:33:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:34.022977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962badf-caa8-4b7a-902f-0c6cee2ad9c8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:34.024585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c962badf-caa8-4b7a-902f-0c6cee2ad9c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:34.084836 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:34.142883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962badf-caa8-4b7a-902f-0c6cee2ad9c8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:34.227099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16026fa4-0fad-4a1f-8cb0-e9de7c91cd46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:34.227846 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16026fa4-0fad-4a1f-8cb0-e9de7c91cd46 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:34.228163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16026fa4-0fad-4a1f-8cb0-e9de7c91cd46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:34.228466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16026fa4-0fad-4a1f-8cb0-e9de7c91cd46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:34.230287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-16026fa4-0fad-4a1f-8cb0-e9de7c91cd46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:34.341289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:34.357233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16026fa4-0fad-4a1f-8cb0-e9de7c91cd46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:34.358770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16026fa4-0fad-4a1f-8cb0-e9de7c91cd46 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:34.378293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 676/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:34.389173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80167f-b17e-43fa-aeaf-a9c4c310ab03 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:34.389622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80167f-b17e-43fa-aeaf-a9c4c310ab03 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:34.389888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80167f-b17e-43fa-aeaf-a9c4c310ab03 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:34.394796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 698/1374] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:34.396453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837eba4-36df-48e4-8a57-6babd0f9cda5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:34.396770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837eba4-36df-48e4-8a57-6babd0f9cda5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:34.397130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837eba4-36df-48e4-8a57-6babd0f9cda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:34.468202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0837eba4-36df-48e4-8a57-6babd0f9cda5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:34.469628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0837eba4-36df-48e4-8a57-6babd0f9cda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:34.580053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 677/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:33:34.629452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80167f-b17e-43fa-aeaf-a9c4c310ab03 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:34.631012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9b80167f-b17e-43fa-aeaf-a9c4c310ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:34.808082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80167f-b17e-43fa-aeaf-a9c4c310ab03 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:34.863737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:34.931492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ac443-7be8-4c73-9e56-7da27905c552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:34.932189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac443-7be8-4c73-9e56-7da27905c552 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:34.933858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac443-7be8-4c73-9e56-7da27905c552 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:34.934162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ac443-7be8-4c73-9e56-7da27905c552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:34.937812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bd3ac443-7be8-4c73-9e56-7da27905c552 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:35.034935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ac443-7be8-4c73-9e56-7da27905c552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:35.036747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ac443-7be8-4c73-9e56-7da27905c552 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:35.055948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 699/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:37.112728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670033-fac5-4e78-b1b3-380d90b6a2d9 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:37.113344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670033-fac5-4e78-b1b3-380d90b6a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:37.113344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19670033-fac5-4e78-b1b3-380d90b6a2d9 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:37.114680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 678/1377] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:37.120211 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b7c1-543b-4fd0-ae24-3a430b7ef216 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:37.120613 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b7c1-543b-4fd0-ae24-3a430b7ef216 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:37.120769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b123b7c1-543b-4fd0-ae24-3a430b7ef216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:37.189017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b123b7c1-543b-4fd0-ae24-3a430b7ef216 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:37.190727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b123b7c1-543b-4fd0-ae24-3a430b7ef216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:37.199835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:37.321236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 700/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:37.366679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19670033-fac5-4e78-b1b3-380d90b6a2d9 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:37.368264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-19670033-fac5-4e78-b1b3-380d90b6a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:37.449369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:37.538387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19670033-fac5-4e78-b1b3-380d90b6a2d9 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:37.672237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bca45-8231-4fbf-94ba-d42410d7720e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:37.672908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bca45-8231-4fbf-94ba-d42410d7720e service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:37.673194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bca45-8231-4fbf-94ba-d42410d7720e service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:37.673464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bca45-8231-4fbf-94ba-d42410d7720e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:37.675253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-716bca45-8231-4fbf-94ba-d42410d7720e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:37.704235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:37.772434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bca45-8231-4fbf-94ba-d42410d7720e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:37.774216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bca45-8231-4fbf-94ba-d42410d7720e service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:37.796527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 679/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:39.905372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb866-bbb9-4edf-9ecc-c2007910baa6 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:39.907466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb866-bbb9-4edf-9ecc-c2007910baa6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:39.908150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbb866-bbb9-4edf-9ecc-c2007910baa6 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:39.910166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 701/1380] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:39.915351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1e698-51a1-4714-8599-5b1050bc2975 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:39.915853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1e698-51a1-4714-8599-5b1050bc2975 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:39.915949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1e698-51a1-4714-8599-5b1050bc2975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:39.991430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-fff1e698-51a1-4714-8599-5b1050bc2975 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:39.992799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fff1e698-51a1-4714-8599-5b1050bc2975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:40.099465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:40.107183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 680/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:40.153343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbb866-bbb9-4edf-9ecc-c2007910baa6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:40.155309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6bcbb866-bbb9-4edf-9ecc-c2007910baa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:40.313725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:40.328798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbb866-bbb9-4edf-9ecc-c2007910baa6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:40.456786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafbb77-af9d-4853-ab11-758e6c42e828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:40.457468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafbb77-af9d-4853-ab11-758e6c42e828 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:40.457817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafbb77-af9d-4853-ab11-758e6c42e828 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:40.458159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafbb77-af9d-4853-ab11-758e6c42e828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:40.460035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1bafbb77-af9d-4853-ab11-758e6c42e828 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:40.553993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafbb77-af9d-4853-ab11-758e6c42e828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:40.555743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafbb77-af9d-4853-ab11-758e6c42e828 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:40.567421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:40.576887 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 702/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:42.650380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74e1d9-84af-46c8-86bb-82c009f1be86 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:42.650936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74e1d9-84af-46c8-86bb-82c009f1be86 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:42.651227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74e1d9-84af-46c8-86bb-82c009f1be86 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:42.653300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 681/1383] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:42.658942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84de554-17b4-4bfa-a4bf-f88a5a61d96e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:42.659410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84de554-17b4-4bfa-a4bf-f88a5a61d96e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:42.659521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84de554-17b4-4bfa-a4bf-f88a5a61d96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:42.726258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c84de554-17b4-4bfa-a4bf-f88a5a61d96e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:42.727472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c84de554-17b4-4bfa-a4bf-f88a5a61d96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:42.824928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 703/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:33:42.869350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74e1d9-84af-46c8-86bb-82c009f1be86 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:42.870928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fb74e1d9-84af-46c8-86bb-82c009f1be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:43.029348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74e1d9-84af-46c8-86bb-82c009f1be86 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:43.104493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:43.170014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69448a54-0dc0-4ad4-a8fe-e182faae70a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:43.171012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448a54-0dc0-4ad4-a8fe-e182faae70a4 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:43.171377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448a54-0dc0-4ad4-a8fe-e182faae70a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:43.171780 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69448a54-0dc0-4ad4-a8fe-e182faae70a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:43.174338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-69448a54-0dc0-4ad4-a8fe-e182faae70a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:43.285615 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69448a54-0dc0-4ad4-a8fe-e182faae70a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:43.292641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69448a54-0dc0-4ad4-a8fe-e182faae70a4 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:43.320651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 682/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:45.353927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf5da-ce8d-4a02-bcc6-c26a9b2eb4ef None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:45.354463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf5da-ce8d-4a02-bcc6-c26a9b2eb4ef None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:45.354577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2decf5da-ce8d-4a02-bcc6-c26a9b2eb4ef None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:45.356176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 704/1386] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:45.362349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c3d2d-ed3a-48d9-bb97-b03254633812 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:45.362914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c3d2d-ed3a-48d9-bb97-b03254633812 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:45.362914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c3d2d-ed3a-48d9-bb97-b03254633812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:45.433306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d39c3d2d-ed3a-48d9-bb97-b03254633812 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:45.434509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d39c3d2d-ed3a-48d9-bb97-b03254633812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:45.467657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:45.534824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 683/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:45.581032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decf5da-ce8d-4a02-bcc6-c26a9b2eb4ef None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:45.582739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2decf5da-ce8d-4a02-bcc6-c26a9b2eb4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:45.676000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:45.762903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2decf5da-ce8d-4a02-bcc6-c26a9b2eb4ef None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:45.897422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f6788-14a7-4788-a08e-d0639fbd9049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:45.898082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f6788-14a7-4788-a08e-d0639fbd9049 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:45.898361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f6788-14a7-4788-a08e-d0639fbd9049 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:45.898632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f6788-14a7-4788-a08e-d0639fbd9049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:45.900348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f81f6788-14a7-4788-a08e-d0639fbd9049 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:45.940902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:45.994824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f6788-14a7-4788-a08e-d0639fbd9049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:45.996659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81f6788-14a7-4788-a08e-d0639fbd9049 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:46.015895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 705/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:33:48.047963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54907-d7d9-4880-881d-ff035cf98061 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:48.048520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54907-d7d9-4880-881d-ff035cf98061 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:48.048520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c54907-d7d9-4880-881d-ff035cf98061 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:48.049810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 684/1389] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:48.055253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1643-d620-4510-a32a-66fe38c4e773 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:48.055729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1643-d620-4510-a32a-66fe38c4e773 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:48.055825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c1643-d620-4510-a32a-66fe38c4e773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:48.124784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-703c1643-d620-4510-a32a-66fe38c4e773 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:48.126042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-703c1643-d620-4510-a32a-66fe38c4e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:48.228280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 706/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:48.272402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c54907-d7d9-4880-881d-ff035cf98061 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:48.273977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-71c54907-d7d9-4880-881d-ff035cf98061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:48.428175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c54907-d7d9-4880-881d-ff035cf98061 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:48.445657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:48.549738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71400bb5-750f-478f-a612-b870cbe95066 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:48.550404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71400bb5-750f-478f-a612-b870cbe95066 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:48.550642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71400bb5-750f-478f-a612-b870cbe95066 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:48.550932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71400bb5-750f-478f-a612-b870cbe95066 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:48.552609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-71400bb5-750f-478f-a612-b870cbe95066 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:48.645489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71400bb5-750f-478f-a612-b870cbe95066 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:48.647633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71400bb5-750f-478f-a612-b870cbe95066 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:48.666718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 685/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:49.512238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97e7d-d8f9-4c20-8572-7887fad01518 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:49.512796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97e7d-d8f9-4c20-8572-7887fad01518 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:49.512796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b97e7d-d8f9-4c20-8572-7887fad01518 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:49.514324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 707/1392] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:49.519500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99260-63f4-44ff-9785-5ea12a850e76 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:49.519957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99260-63f4-44ff-9785-5ea12a850e76 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:49.520071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f99260-63f4-44ff-9785-5ea12a850e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:49.545354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:49.588629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-42f99260-63f4-44ff-9785-5ea12a850e76 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:49.589859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-42f99260-63f4-44ff-9785-5ea12a850e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:49.695281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 686/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:49.750160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62049-4db3-4b73-9d1d-7fc21df26110 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:49.750523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62049-4db3-4b73-9d1d-7fc21df26110 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:49.750869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da62049-4db3-4b73-9d1d-7fc21df26110 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:49.752354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 708/1394] 10.222.0.64 () {54 vars in 962 bytes} [Tue Jul 12 13:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:49.757730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15397e-5077-4ae6-a2e4-ac2de580fdb4 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:49.758016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15397e-5077-4ae6-a2e4-ac2de580fdb4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:49.758288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15397e-5077-4ae6-a2e4-ac2de580fdb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:49.838939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-9a15397e-5077-4ae6-a2e4-ac2de580fdb4 None None] MFA Rules not processed for user `b1dd830b8f7846e78d8f007ac436d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:49.840190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9a15397e-5077-4ae6-a2e4-ac2de580fdb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:49.884492 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:49.922828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 687/1395] 10.222.0.64 () {58 vars in 1059 bytes} [Tue Jul 12 13:33:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:49.930635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da62049-4db3-4b73-9d1d-7fc21df26110 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:49.932189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8da62049-4db3-4b73-9d1d-7fc21df26110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:49.946263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:50.037319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da62049-4db3-4b73-9d1d-7fc21df26110 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:50.108836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d34c8-27d5-40c4-a655-07117302f10f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:50.109400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d34c8-27d5-40c4-a655-07117302f10f service glance] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:50.109680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d34c8-27d5-40c4-a655-07117302f10f service glance] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:50.109959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d34c8-27d5-40c4-a655-07117302f10f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:50.111623 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e27d34c8-27d5-40c4-a655-07117302f10f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:50.177300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:50.218635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d34c8-27d5-40c4-a655-07117302f10f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:50.220115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d34c8-27d5-40c4-a655-07117302f10f service glance] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:50.239076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 709/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:50.728865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bdc9b-3560-441e-9496-4da546be8848 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:50.729414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bdc9b-3560-441e-9496-4da546be8848 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:50.729414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2bdc9b-3560-441e-9496-4da546be8848 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:50.730880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 688/1397] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:50.737045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1494-2cd7-491b-9daf-c9ab271089f7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:50.737436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1494-2cd7-491b-9daf-c9ab271089f7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:50.737535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae1494-2cd7-491b-9daf-c9ab271089f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:50.806324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0dae1494-2cd7-491b-9daf-c9ab271089f7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:50.808295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0dae1494-2cd7-491b-9daf-c9ab271089f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:50.914347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 710/1398] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:50.959095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bdc9b-3560-441e-9496-4da546be8848 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:50.960895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8a2bdc9b-3560-441e-9496-4da546be8848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:50.971379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223be6f-c6b2-4efa-99c2-e0cadd6ecfd7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:50.971762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223be6f-c6b2-4efa-99c2-e0cadd6ecfd7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:50.972119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e223be6f-c6b2-4efa-99c2-e0cadd6ecfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:50.997183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:51.036786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e223be6f-c6b2-4efa-99c2-e0cadd6ecfd7 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:51.038698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e223be6f-c6b2-4efa-99c2-e0cadd6ecfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:51.109368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2bdc9b-3560-441e-9496-4da546be8848 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:51.131958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 711/1399] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:33:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:51.159567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:51.180178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf0b8-0c88-43b3-ade7-7cd1c7a5c46a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:51.180481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf0b8-0c88-43b3-ade7-7cd1c7a5c46a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:51.180741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cf0b8-0c88-43b3-ade7-7cd1c7a5c46a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:51.182163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 712/1400] 10.222.0.64 () {54 vars in 942 bytes} [Tue Jul 12 13:33:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:51.188314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93935-8e3f-4404-84a5-a697daf75171 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:51.188626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93935-8e3f-4404-84a5-a697daf75171 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:51.188905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d93935-8e3f-4404-84a5-a697daf75171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:51.228314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:51.229098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:51.229407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:51.229683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:51.231375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:51.263141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-99d93935-8e3f-4404-84a5-a697daf75171 None None] MFA Rules not processed for user `a57f6f39bba04a9d80a885340239cea3`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:51.264460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-99d93935-8e3f-4404-84a5-a697daf75171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:51.317440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:51.324097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:51.325716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:51.343879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 689/1401] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:51.374189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 713/1402] 10.222.0.64 () {58 vars in 1039 bytes} [Tue Jul 12 13:33:51 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:33:51.384578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:51.385856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:51.446658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:51.485563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb47e7-e80c-480f-8f6d-09ba30f0f435 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:51.607858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25fe88-0b24-4461-978d-3345530cb3a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:51.608515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25fe88-0b24-4461-978d-3345530cb3a8 service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:51.608793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25fe88-0b24-4461-978d-3345530cb3a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:51.609062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25fe88-0b24-4461-978d-3345530cb3a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:51.610734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2b25fe88-0b24-4461-978d-3345530cb3a8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:51.698643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25fe88-0b24-4461-978d-3345530cb3a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:51.700219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25fe88-0b24-4461-978d-3345530cb3a8 service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:51.705321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:51.709565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 690/1403] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:33:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 13:33:53.402213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d070173-28c2-4363-9e1f-4b8220bf0271 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:53.402805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d070173-28c2-4363-9e1f-4b8220bf0271 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:53.402805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d070173-28c2-4363-9e1f-4b8220bf0271 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:53.408218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 714/1404] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:53.410115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647120-150f-4d5e-98d9-c09c8b435885 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:53.410629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647120-150f-4d5e-98d9-c09c8b435885 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:53.410751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1647120-150f-4d5e-98d9-c09c8b435885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:53.490483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e1647120-150f-4d5e-98d9-c09c8b435885 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:53.493960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e1647120-150f-4d5e-98d9-c09c8b435885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:53.607772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 691/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:53.645511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d070173-28c2-4363-9e1f-4b8220bf0271 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:53.647062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0d070173-28c2-4363-9e1f-4b8220bf0271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:53.821049 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d070173-28c2-4363-9e1f-4b8220bf0271 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:53.850157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:53.942746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305e38b-b2fa-4c47-a54b-4927c123ecd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:53.943427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e38b-b2fa-4c47-a54b-4927c123ecd4 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:53.943818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e38b-b2fa-4c47-a54b-4927c123ecd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:53.944195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305e38b-b2fa-4c47-a54b-4927c123ecd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:53.945950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9305e38b-b2fa-4c47-a54b-4927c123ecd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:54.046023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e38b-b2fa-4c47-a54b-4927c123ecd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:54.047654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305e38b-b2fa-4c47-a54b-4927c123ecd4 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:54.069970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 715/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:33:56.130521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc5a2b-5826-4c19-a43f-4bce38eaf8e7 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:56.131184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc5a2b-5826-4c19-a43f-4bce38eaf8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:56.131184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc5a2b-5826-4c19-a43f-4bce38eaf8e7 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:56.132521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 692/1407] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:33:56.137794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6ba2-9e65-4e7d-92fc-34e1503ee3c2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:56.138214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6ba2-9e65-4e7d-92fc-34e1503ee3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:56.138410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb6ba2-9e65-4e7d-92fc-34e1503ee3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:56.183097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:56.209195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4bbb6ba2-9e65-4e7d-92fc-34e1503ee3c2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:33:56.210481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4bbb6ba2-9e65-4e7d-92fc-34e1503ee3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:56.317822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 716/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:33:56.362138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc5a2b-5826-4c19-a43f-4bce38eaf8e7 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:33:56.363950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-93bc5a2b-5826-4c19-a43f-4bce38eaf8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:56.455168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:56.528453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc5a2b-5826-4c19-a43f-4bce38eaf8e7 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:33:56.653407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48cf3d-9da6-440d-bcf0-5b48cfda8e23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:33:56.654179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48cf3d-9da6-440d-bcf0-5b48cfda8e23 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:33:56.654367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48cf3d-9da6-440d-bcf0-5b48cfda8e23 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:33:56.654674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48cf3d-9da6-440d-bcf0-5b48cfda8e23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:33:56.656437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4b48cf3d-9da6-440d-bcf0-5b48cfda8e23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:33:56.703962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:33:56.754220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48cf3d-9da6-440d-bcf0-5b48cfda8e23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:33:56.755788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b48cf3d-9da6-440d-bcf0-5b48cfda8e23 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:33:56.777752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 693/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:06.315730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=51 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:06.774773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=27 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:13.747522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194ee1-c32b-4da3-a68a-c52746fd2ae8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:13.748141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194ee1-c32b-4da3-a68a-c52746fd2ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:13.748141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08194ee1-c32b-4da3-a68a-c52746fd2ae8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:13.749470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 717/1410] 10.222.0.64 () {54 vars in 918 bytes} [Tue Jul 12 13:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:13.755471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c342-6483-458b-b213-0de78ddfac53 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:13.755989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c342-6483-458b-b213-0de78ddfac53 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:13.756139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351c342-6483-458b-b213-0de78ddfac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:13.838717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b351c342-6483-458b-b213-0de78ddfac53 None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:13.839946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b351c342-6483-458b-b213-0de78ddfac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:13.965513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 694/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Tue Jul 12 13:34:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:13.982131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0596-9568-479d-be32-d0ac4d85904f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:13.982413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0596-9568-479d-be32-d0ac4d85904f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:13.982682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844a0596-9568-479d-be32-d0ac4d85904f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:13.984085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 718/1412] 10.222.0.64 () {54 vars in 918 bytes} [Tue Jul 12 13:34:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:13.990424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155c86-c470-4e5a-8f61-4f22375fb592 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:13.990716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155c86-c470-4e5a-8f61-4f22375fb592 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:13.990996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25155c86-c470-4e5a-8f61-4f22375fb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:14.065601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:14.069164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-25155c86-c470-4e5a-8f61-4f22375fb592 None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:14.071159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-25155c86-c470-4e5a-8f61-4f22375fb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:14.189741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 695/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Tue Jul 12 13:34:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:16.663517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bebd9b-be0e-43a9-a921-492d7d71f1b1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:16.664040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bebd9b-be0e-43a9-a921-492d7d71f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:16.664151 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bebd9b-be0e-43a9-a921-492d7d71f1b1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:16.665544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:16.674094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e18933-4c26-4770-b9a9-ec8cb4dd2dfb None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:16.674507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e18933-4c26-4770-b9a9-ec8cb4dd2dfb None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:16.674720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e18933-4c26-4770-b9a9-ec8cb4dd2dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:16.748440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-69e18933-4c26-4770-b9a9-ec8cb4dd2dfb None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:16.749672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-69e18933-4c26-4770-b9a9-ec8cb4dd2dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:16.811036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:16.855875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:16.901384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bebd9b-be0e-43a9-a921-492d7d71f1b1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:16.902899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-09bebd9b-be0e-43a9-a921-492d7d71f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:17.059440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bebd9b-be0e-43a9-a921-492d7d71f1b1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:17.149075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:17.190485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd8333-a7cb-436a-9bdb-724d7d5b0294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:17.191139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8333-a7cb-436a-9bdb-724d7d5b0294 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:17.191415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8333-a7cb-436a-9bdb-724d7d5b0294 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:17.192039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd8333-a7cb-436a-9bdb-724d7d5b0294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:17.193728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a9fd8333-a7cb-436a-9bdb-724d7d5b0294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:17.287269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd8333-a7cb-436a-9bdb-724d7d5b0294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:17.289123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd8333-a7cb-436a-9bdb-724d7d5b0294 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:17.308530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 720/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:34:18.217031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498446cf-fbd7-41d0-8a7f-2328a7a844e2 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:18.217898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498446cf-fbd7-41d0-8a7f-2328a7a844e2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:18.217898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498446cf-fbd7-41d0-8a7f-2328a7a844e2 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:18.220303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:34:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:18.227963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96c36-7f71-4741-bcb7-7e0d16bb21d4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:18.228390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96c36-7f71-4741-bcb7-7e0d16bb21d4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:18.228533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f96c36-7f71-4741-bcb7-7e0d16bb21d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:18.314055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-41f96c36-7f71-4741-bcb7-7e0d16bb21d4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:18.315996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-41f96c36-7f71-4741-bcb7-7e0d16bb21d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:18.344718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:18.418626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:18.570740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498446cf-fbd7-41d0-8a7f-2328a7a844e2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:18.573271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-498446cf-fbd7-41d0-8a7f-2328a7a844e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:18.739448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498446cf-fbd7-41d0-8a7f-2328a7a844e2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:18.781521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:18.872102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc427b-a0d3-4c50-833d-d2bd492fff5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:18.873020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc427b-a0d3-4c50-833d-d2bd492fff5e service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:18.873524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc427b-a0d3-4c50-833d-d2bd492fff5e service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:18.873810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc427b-a0d3-4c50-833d-d2bd492fff5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:18.876575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9fcc427b-a0d3-4c50-833d-d2bd492fff5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:18.972719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc427b-a0d3-4c50-833d-d2bd492fff5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:18.974416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc427b-a0d3-4c50-833d-d2bd492fff5e service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:18.992215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 698/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:19.872095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaecbf-1b5a-4a8d-bfc0-0adfaf84e8c8 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:19.873001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaecbf-1b5a-4a8d-bfc0-0adfaf84e8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:19.873001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaecbf-1b5a-4a8d-bfc0-0adfaf84e8c8 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:19.875123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:34:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:19.882616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7413e61-a4b8-4243-af89-63952c02b516 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:19.883062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7413e61-a4b8-4243-af89-63952c02b516 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:19.883155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7413e61-a4b8-4243-af89-63952c02b516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:19.937676 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:19.960787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-a7413e61-a4b8-4243-af89-63952c02b516 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:19.962026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a7413e61-a4b8-4243-af89-63952c02b516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:20.063479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:34:20.219508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaecbf-1b5a-4a8d-bfc0-0adfaf84e8c8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:20.221759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56eaecbf-1b5a-4a8d-bfc0-0adfaf84e8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:20.388243 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaecbf-1b5a-4a8d-bfc0-0adfaf84e8c8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:20.405688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:20.525552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8a19b-a8d1-407f-b67d-8d9941a09012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:20.526119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8a19b-a8d1-407f-b67d-8d9941a09012 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:20.526381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8a19b-a8d1-407f-b67d-8d9941a09012 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:20.526681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8a19b-a8d1-407f-b67d-8d9941a09012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:20.528439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4fe8a19b-a8d1-407f-b67d-8d9941a09012 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:20.645431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8a19b-a8d1-407f-b67d-8d9941a09012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:20.647068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8a19b-a8d1-407f-b67d-8d9941a09012 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:20.667003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 723/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:21.554007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4c107-efd5-4c0f-85d5-ddba8549095d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:21.554577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4c107-efd5-4c0f-85d5-ddba8549095d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:21.554577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4c107-efd5-4c0f-85d5-ddba8549095d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:21.556725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:34:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:21.564060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e197e3e-5484-4bd4-ab1c-9350fc69fab3 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:21.564521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e197e3e-5484-4bd4-ab1c-9350fc69fab3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:21.564601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e197e3e-5484-4bd4-ab1c-9350fc69fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:21.594293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:21.657590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0e197e3e-5484-4bd4-ab1c-9350fc69fab3 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:21.658813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0e197e3e-5484-4bd4-ab1c-9350fc69fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:21.769470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:21.924816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4c107-efd5-4c0f-85d5-ddba8549095d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:21.927255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-16b4c107-efd5-4c0f-85d5-ddba8549095d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:22.050849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:22.088289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4c107-efd5-4c0f-85d5-ddba8549095d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:22.218744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d59a41a-18d5-4eac-b2b5-8213fddd2809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:22.219291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a41a-18d5-4eac-b2b5-8213fddd2809 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:22.219568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a41a-18d5-4eac-b2b5-8213fddd2809 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:22.219877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d59a41a-18d5-4eac-b2b5-8213fddd2809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:22.221556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6d59a41a-18d5-4eac-b2b5-8213fddd2809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:22.303803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:22.319527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59a41a-18d5-4eac-b2b5-8213fddd2809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:22.321174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d59a41a-18d5-4eac-b2b5-8213fddd2809 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:22.340357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 701/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:23.192416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942885d3-e2b8-4a38-9b7a-4c3087730085 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:23.193313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942885d3-e2b8-4a38-9b7a-4c3087730085 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:23.193313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942885d3-e2b8-4a38-9b7a-4c3087730085 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:23.195554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:34:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:34:23.200757 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265db7b8-5baf-47cf-97b3-f329b28c5ad5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:23.201192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265db7b8-5baf-47cf-97b3-f329b28c5ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:23.201288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265db7b8-5baf-47cf-97b3-f329b28c5ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:23.275661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-265db7b8-5baf-47cf-97b3-f329b28c5ad5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:23.276892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-265db7b8-5baf-47cf-97b3-f329b28c5ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:23.381012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:23.538967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942885d3-e2b8-4a38-9b7a-4c3087730085 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:23.541186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-942885d3-e2b8-4a38-9b7a-4c3087730085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:23.641890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:23.705983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942885d3-e2b8-4a38-9b7a-4c3087730085 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:23.828917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8496fb2-88b3-4377-ac8f-a5b7dcc9de02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:23.829585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8496fb2-88b3-4377-ac8f-a5b7dcc9de02 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:23.829830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8496fb2-88b3-4377-ac8f-a5b7dcc9de02 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:23.830135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8496fb2-88b3-4377-ac8f-a5b7dcc9de02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:23.831926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b8496fb2-88b3-4377-ac8f-a5b7dcc9de02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:23.897731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:23.944284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8496fb2-88b3-4377-ac8f-a5b7dcc9de02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:23.945897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8496fb2-88b3-4377-ac8f-a5b7dcc9de02 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:23.964110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 726/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:24.772161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dece2e-6a43-4072-826b-d4b968172759 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:24.772752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dece2e-6a43-4072-826b-d4b968172759 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:24.772752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dece2e-6a43-4072-826b-d4b968172759 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:24.774088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:34:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:24.779970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57040e-9b1e-430a-8cab-6d95daa4fc58 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:24.780647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57040e-9b1e-430a-8cab-6d95daa4fc58 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:24.780768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57040e-9b1e-430a-8cab-6d95daa4fc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:24.867047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ce57040e-9b1e-430a-8cab-6d95daa4fc58 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:24.869613 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ce57040e-9b1e-430a-8cab-6d95daa4fc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:24.971981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:25.120293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dece2e-6a43-4072-826b-d4b968172759 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:25.122734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-30dece2e-6a43-4072-826b-d4b968172759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:25.179657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:25.280302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dece2e-6a43-4072-826b-d4b968172759 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:25.400998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64410d-9fd8-4937-b157-61885a30d577 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:25.401660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64410d-9fd8-4937-b157-61885a30d577 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:25.401945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64410d-9fd8-4937-b157-61885a30d577 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:25.402323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64410d-9fd8-4937-b157-61885a30d577 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:25.404038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cf64410d-9fd8-4937-b157-61885a30d577 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:25.411360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:25.497217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64410d-9fd8-4937-b157-61885a30d577 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:25.498832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64410d-9fd8-4937-b157-61885a30d577 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:25.518182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 704/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:26.317883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715b93-cab2-4ff6-8ac0-14fafee1d914 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:26.318536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715b93-cab2-4ff6-8ac0-14fafee1d914 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:26.318536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45715b93-cab2-4ff6-8ac0-14fafee1d914 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:26.319893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:34:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:26.325132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8952e7-8520-4107-b5c5-115a5493d7a1 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:26.325584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8952e7-8520-4107-b5c5-115a5493d7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:26.325688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8952e7-8520-4107-b5c5-115a5493d7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:26.411627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0e8952e7-8520-4107-b5c5-115a5493d7a1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:26.412874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0e8952e7-8520-4107-b5c5-115a5493d7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:26.485064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:26.516176 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:26.665554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715b93-cab2-4ff6-8ac0-14fafee1d914 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:26.667993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-45715b93-cab2-4ff6-8ac0-14fafee1d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:26.695102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:26.841764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45715b93-cab2-4ff6-8ac0-14fafee1d914 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:26.934785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:26.963420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f053257-06d3-4d6b-9e74-6b2383d0b50d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:26.964106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053257-06d3-4d6b-9e74-6b2383d0b50d service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:26.964383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053257-06d3-4d6b-9e74-6b2383d0b50d service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:26.964655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f053257-06d3-4d6b-9e74-6b2383d0b50d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:26.966332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0f053257-06d3-4d6b-9e74-6b2383d0b50d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:27.057373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053257-06d3-4d6b-9e74-6b2383d0b50d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:27.059006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f053257-06d3-4d6b-9e74-6b2383d0b50d service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:27.077504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 729/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:27.874383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de821dd-2580-4045-9ec5-c4086395d710 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:27.875268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de821dd-2580-4045-9ec5-c4086395d710 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:27.875268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de821dd-2580-4045-9ec5-c4086395d710 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:27.877636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:34:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:27.882956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d571bc-ba43-4a46-b1c7-9a31f17be032 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:27.883399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d571bc-ba43-4a46-b1c7-9a31f17be032 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:27.883503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d571bc-ba43-4a46-b1c7-9a31f17be032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:27.962833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-81d571bc-ba43-4a46-b1c7-9a31f17be032 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:27.964096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-81d571bc-ba43-4a46-b1c7-9a31f17be032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:28.007278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:28.062666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:28.214300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de821dd-2580-4045-9ec5-c4086395d710 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:28.216595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9de821dd-2580-4045-9ec5-c4086395d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:28.388355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de821dd-2580-4045-9ec5-c4086395d710 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:28.447830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:28.506984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208d455-d68b-4f33-9f6b-0abcafae92fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:28.507559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d455-d68b-4f33-9f6b-0abcafae92fa service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:28.507864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d455-d68b-4f33-9f6b-0abcafae92fa service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:28.508133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208d455-d68b-4f33-9f6b-0abcafae92fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:28.509772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0208d455-d68b-4f33-9f6b-0abcafae92fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:28.617824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208d455-d68b-4f33-9f6b-0abcafae92fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:28.619439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208d455-d68b-4f33-9f6b-0abcafae92fa service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:28.638904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 707/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:29.440752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05085e13-6057-4988-8f6a-1fd1bd19ea5b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:29.441662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05085e13-6057-4988-8f6a-1fd1bd19ea5b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:29.441662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05085e13-6057-4988-8f6a-1fd1bd19ea5b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:29.443129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:34:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:29.449574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6523f5-807c-48a0-bd95-7f04907acb79 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:29.450296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6523f5-807c-48a0-bd95-7f04907acb79 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:29.450447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6523f5-807c-48a0-bd95-7f04907acb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:29.535938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-aa6523f5-807c-48a0-bd95-7f04907acb79 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:29.537246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-aa6523f5-807c-48a0-bd95-7f04907acb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:29.539351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:29.639635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:34:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:29.789747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05085e13-6057-4988-8f6a-1fd1bd19ea5b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:29.792025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-05085e13-6057-4988-8f6a-1fd1bd19ea5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:29.957048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05085e13-6057-4988-8f6a-1fd1bd19ea5b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:29.988110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:30.201983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4091b-b41a-4025-81c3-16a093292e31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:30.202633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4091b-b41a-4025-81c3-16a093292e31 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:30.202913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4091b-b41a-4025-81c3-16a093292e31 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:30.203180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4091b-b41a-4025-81c3-16a093292e31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:30.204860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-59f4091b-b41a-4025-81c3-16a093292e31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:30.308834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4091b-b41a-4025-81c3-16a093292e31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:30.310434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4091b-b41a-4025-81c3-16a093292e31 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:30.328852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 732/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:32.246060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019157c-2e32-4f9b-8c9c-f1c2af57ba90 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:32.246684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019157c-2e32-4f9b-8c9c-f1c2af57ba90 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:32.246684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019157c-2e32-4f9b-8c9c-f1c2af57ba90 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:32.248005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:32.254486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedad53-544c-4047-9515-22c2de882add None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:32.255395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedad53-544c-4047-9515-22c2de882add None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:32.255395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbedad53-544c-4047-9515-22c2de882add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:32.301042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:32.326335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-fbedad53-544c-4047-9515-22c2de882add None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:32.327529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fbedad53-544c-4047-9515-22c2de882add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:32.428384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:32.466798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019157c-2e32-4f9b-8c9c-f1c2af57ba90 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:32.468406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4019157c-2e32-4f9b-8c9c-f1c2af57ba90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:32.581885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019157c-2e32-4f9b-8c9c-f1c2af57ba90 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:32.615735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:32.660538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9ea64-e1df-47fd-9eb9-d433ceeb1ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:32.661263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ea64-e1df-47fd-9eb9-d433ceeb1ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:32.661554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ea64-e1df-47fd-9eb9-d433ceeb1ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:32.661823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ea64-e1df-47fd-9eb9-d433ceeb1ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:32.663495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-53e9ea64-e1df-47fd-9eb9-d433ceeb1ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:32.776220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9ea64-e1df-47fd-9eb9-d433ceeb1ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:32.777579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9ea64-e1df-47fd-9eb9-d433ceeb1ea1 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:32.795847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 710/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:34.996052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb08846-8d50-430a-8781-7ef608473018 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:34.996615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb08846-8d50-430a-8781-7ef608473018 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:34.996615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb08846-8d50-430a-8781-7ef608473018 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:34.997906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:35.004619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0a43-4188-4bf4-91b7-ca391029c965 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:35.005389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0a43-4188-4bf4-91b7-ca391029c965 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:35.005600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f0a43-4188-4bf4-91b7-ca391029c965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:35.086123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-139f0a43-4188-4bf4-91b7-ca391029c965 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:35.087328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-139f0a43-4188-4bf4-91b7-ca391029c965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:35.100874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:35.194188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:35.237904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb08846-8d50-430a-8781-7ef608473018 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:35.239957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-deb08846-8d50-430a-8781-7ef608473018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:35.357112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb08846-8d50-430a-8781-7ef608473018 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:35.369953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:35.440796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc4f24-0a52-4dab-b476-dafd5fc476d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:35.442177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4f24-0a52-4dab-b476-dafd5fc476d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:35.442500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4f24-0a52-4dab-b476-dafd5fc476d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:35.442776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc4f24-0a52-4dab-b476-dafd5fc476d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:35.444510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-47cc4f24-0a52-4dab-b476-dafd5fc476d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:35.557292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc4f24-0a52-4dab-b476-dafd5fc476d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:35.558720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc4f24-0a52-4dab-b476-dafd5fc476d4 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:35.578068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 735/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:37.955021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471a28-58f4-4b45-b6d7-6dd21e689a61 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:37.955634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471a28-58f4-4b45-b6d7-6dd21e689a61 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:37.955634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5471a28-58f4-4b45-b6d7-6dd21e689a61 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:37.956984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:37.963585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746d53e-b0a2-43db-8077-bbe013b03a9f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:37.964357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746d53e-b0a2-43db-8077-bbe013b03a9f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:37.964526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2746d53e-b0a2-43db-8077-bbe013b03a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:38.021202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:38.040455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2746d53e-b0a2-43db-8077-bbe013b03a9f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:38.041907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2746d53e-b0a2-43db-8077-bbe013b03a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:38.173637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:38.213888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5471a28-58f4-4b45-b6d7-6dd21e689a61 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:38.216467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d5471a28-58f4-4b45-b6d7-6dd21e689a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:38.348692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5471a28-58f4-4b45-b6d7-6dd21e689a61 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:38.392383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:38.429462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f991c45-c266-4ac6-8f03-c9fa96771548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:38.430117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991c45-c266-4ac6-8f03-c9fa96771548 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:38.430405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991c45-c266-4ac6-8f03-c9fa96771548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:38.430677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991c45-c266-4ac6-8f03-c9fa96771548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:38.432520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7f991c45-c266-4ac6-8f03-c9fa96771548 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:38.552180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f991c45-c266-4ac6-8f03-c9fa96771548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:38.553543 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f991c45-c266-4ac6-8f03-c9fa96771548 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:38.572734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 713/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:40.722195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742a63-3893-41e7-96e6-39a7938ef851 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:40.722766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742a63-3893-41e7-96e6-39a7938ef851 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:40.722766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742a63-3893-41e7-96e6-39a7938ef851 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:40.724282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:40.730842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b36a4-fb44-4e92-8796-1292544178d5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:40.731283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b36a4-fb44-4e92-8796-1292544178d5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:40.731425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b36a4-fb44-4e92-8796-1292544178d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:40.817972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-cc2b36a4-fb44-4e92-8796-1292544178d5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:40.819199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cc2b36a4-fb44-4e92-8796-1292544178d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:40.840114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:40.920423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:40.963912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a742a63-3893-41e7-96e6-39a7938ef851 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:40.965489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9a742a63-3893-41e7-96e6-39a7938ef851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:41.073108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a742a63-3893-41e7-96e6-39a7938ef851 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:41.093130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:41.147109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176528c-2d45-4d58-abad-a371bb75f84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:41.147794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176528c-2d45-4d58-abad-a371bb75f84e service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:41.148073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176528c-2d45-4d58-abad-a371bb75f84e service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:41.148347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176528c-2d45-4d58-abad-a371bb75f84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:41.149988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6176528c-2d45-4d58-abad-a371bb75f84e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:41.290534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176528c-2d45-4d58-abad-a371bb75f84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:41.292667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176528c-2d45-4d58-abad-a371bb75f84e service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:41.314480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 738/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:43.393921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45039381-47ce-4b18-adca-98f55b3fb5e4 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:43.394546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45039381-47ce-4b18-adca-98f55b3fb5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:43.394546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45039381-47ce-4b18-adca-98f55b3fb5e4 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:43.395957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:43.402124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41673d2-075b-4d0f-a345-bbb177e75175 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:43.402578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41673d2-075b-4d0f-a345-bbb177e75175 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:43.402686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41673d2-075b-4d0f-a345-bbb177e75175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:43.473859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:43.476794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e41673d2-075b-4d0f-a345-bbb177e75175 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:43.478636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e41673d2-075b-4d0f-a345-bbb177e75175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:43.578183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:43.617790 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45039381-47ce-4b18-adca-98f55b3fb5e4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:43.619347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-45039381-47ce-4b18-adca-98f55b3fb5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:43.726783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45039381-47ce-4b18-adca-98f55b3fb5e4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:43.783859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:43.809991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9f55d-3286-49df-9cdd-82a0cc8f3bb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:43.810639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f55d-3286-49df-9cdd-82a0cc8f3bb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:43.810917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f55d-3286-49df-9cdd-82a0cc8f3bb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:43.811183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9f55d-3286-49df-9cdd-82a0cc8f3bb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:43.812876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-80d9f55d-3286-49df-9cdd-82a0cc8f3bb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:43.934246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9f55d-3286-49df-9cdd-82a0cc8f3bb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:43.935643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9f55d-3286-49df-9cdd-82a0cc8f3bb9 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:43.954206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 716/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:46.033646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1e29-1b30-4fa2-beee-2a581377da4f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:46.034175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1e29-1b30-4fa2-beee-2a581377da4f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:46.034175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a1e29-1b30-4fa2-beee-2a581377da4f None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:46.035672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:46.044806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca814c-8190-4182-b2ec-b88335023357 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:46.045271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca814c-8190-4182-b2ec-b88335023357 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:46.045376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca814c-8190-4182-b2ec-b88335023357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:46.119069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e5ca814c-8190-4182-b2ec-b88335023357 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:46.120317 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e5ca814c-8190-4182-b2ec-b88335023357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:46.150709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:46.236609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:46.275190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a1e29-1b30-4fa2-beee-2a581377da4f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:46.276840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-506a1e29-1b30-4fa2-beee-2a581377da4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:46.385134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a1e29-1b30-4fa2-beee-2a581377da4f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:46.415495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:46.463802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c023e3-3b69-4a9f-8432-3c00e6f31de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:46.464453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c023e3-3b69-4a9f-8432-3c00e6f31de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:46.464736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c023e3-3b69-4a9f-8432-3c00e6f31de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:46.465018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c023e3-3b69-4a9f-8432-3c00e6f31de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:46.466659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-86c023e3-3b69-4a9f-8432-3c00e6f31de6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:46.576924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c023e3-3b69-4a9f-8432-3c00e6f31de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:46.578346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c023e3-3b69-4a9f-8432-3c00e6f31de6 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:46.597863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 741/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:48.702138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945da42-f61c-4eb0-8bed-8e051af07003 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:48.702641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945da42-f61c-4eb0-8bed-8e051af07003 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:48.702771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945da42-f61c-4eb0-8bed-8e051af07003 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:48.704146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:48.711680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e91a-f019-4da4-a400-700b3f0c2314 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:48.712061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e91a-f019-4da4-a400-700b3f0c2314 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:48.712239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e91a-f019-4da4-a400-700b3f0c2314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:48.789230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-30c2e91a-f019-4da4-a400-700b3f0c2314 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:48.790448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-30c2e91a-f019-4da4-a400-700b3f0c2314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:48.799232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:48.896684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:48.934004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945da42-f61c-4eb0-8bed-8e051af07003 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:48.935579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d945da42-f61c-4eb0-8bed-8e051af07003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:49.060958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945da42-f61c-4eb0-8bed-8e051af07003 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:49.130650 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:49.149840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8ca25-ee69-492f-8536-caff874aae88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:49.150418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ca25-ee69-492f-8536-caff874aae88 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:49.150693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ca25-ee69-492f-8536-caff874aae88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:49.150960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8ca25-ee69-492f-8536-caff874aae88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:49.152639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f8e8ca25-ee69-492f-8536-caff874aae88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:49.264061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8ca25-ee69-492f-8536-caff874aae88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:49.265496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8ca25-ee69-492f-8536-caff874aae88 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:49.283528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 719/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:51.338453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482c38-751d-46c1-bf6a-66b3e57c5767 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:51.339042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482c38-751d-46c1-bf6a-66b3e57c5767 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:51.339042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a482c38-751d-46c1-bf6a-66b3e57c5767 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:51.341297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:51.349423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f28e-8463-431d-bfac-385a76148df8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:51.349916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f28e-8463-431d-bfac-385a76148df8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:51.350016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0f28e-8463-431d-bfac-385a76148df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:51.418401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-93f0f28e-8463-431d-bfac-385a76148df8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:51.419651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-93f0f28e-8463-431d-bfac-385a76148df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:51.462731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:51.523525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:34:51.564545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a482c38-751d-46c1-bf6a-66b3e57c5767 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:51.567379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5a482c38-751d-46c1-bf6a-66b3e57c5767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:51.691136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a482c38-751d-46c1-bf6a-66b3e57c5767 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:51.732496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:51.773285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea23f42-155b-4913-881f-50b6ed9e0134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:51.773931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23f42-155b-4913-881f-50b6ed9e0134 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:51.774206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23f42-155b-4913-881f-50b6ed9e0134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:51.774477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea23f42-155b-4913-881f-50b6ed9e0134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:51.776163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cea23f42-155b-4913-881f-50b6ed9e0134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:51.894791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea23f42-155b-4913-881f-50b6ed9e0134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:51.897191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea23f42-155b-4913-881f-50b6ed9e0134 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:51.922464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 744/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:53.992200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89bcd-0d96-425a-afa6-12e54f5fcf61 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:53.993049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89bcd-0d96-425a-afa6-12e54f5fcf61 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:53.993049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c89bcd-0d96-425a-afa6-12e54f5fcf61 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:53.995198 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:54.003962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af068-4667-4ffc-b31b-0c9a40599b57 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:54.004741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af068-4667-4ffc-b31b-0c9a40599b57 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:54.004929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480af068-4667-4ffc-b31b-0c9a40599b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:54.089948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-480af068-4667-4ffc-b31b-0c9a40599b57 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:54.091154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-480af068-4667-4ffc-b31b-0c9a40599b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:54.110217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:54.194902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:54.241626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c89bcd-0d96-425a-afa6-12e54f5fcf61 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:54.243281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-55c89bcd-0d96-425a-afa6-12e54f5fcf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:54.351910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c89bcd-0d96-425a-afa6-12e54f5fcf61 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:54.427919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:54.435895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f100fafe-8ddd-4261-903a-ef72349df066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:54.436549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100fafe-8ddd-4261-903a-ef72349df066 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:54.436828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100fafe-8ddd-4261-903a-ef72349df066 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:54.437098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f100fafe-8ddd-4261-903a-ef72349df066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:54.438736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f100fafe-8ddd-4261-903a-ef72349df066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:54.558058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100fafe-8ddd-4261-903a-ef72349df066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:54.559435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f100fafe-8ddd-4261-903a-ef72349df066 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:54.578789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 722/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:34:56.608279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04be290-289f-4a58-9010-6a924ec84a01 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:56.609177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04be290-289f-4a58-9010-6a924ec84a01 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:56.609177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04be290-289f-4a58-9010-6a924ec84a01 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:56.611323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:34:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:34:56.617810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0ac4-9bac-4a4a-babd-588a2b8c258a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:56.618482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0ac4-9bac-4a4a-babd-588a2b8c258a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:56.618762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f0ac4-9bac-4a4a-babd-588a2b8c258a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:56.688406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-649f0ac4-9bac-4a4a-babd-588a2b8c258a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:34:56.689647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-649f0ac4-9bac-4a4a-babd-588a2b8c258a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:56.740200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:56.789273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:34:56.828650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04be290-289f-4a58-9010-6a924ec84a01 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:34:56.830343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b04be290-289f-4a58-9010-6a924ec84a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:56.942420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04be290-289f-4a58-9010-6a924ec84a01 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:34:56.990323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:34:57.028364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d8b9d-e82a-4ee7-9b5d-9efa81a899c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:34:57.029029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8b9d-e82a-4ee7-9b5d-9efa81a899c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:34:57.029302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8b9d-e82a-4ee7-9b5d-9efa81a899c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:34:57.029578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d8b9d-e82a-4ee7-9b5d-9efa81a899c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:34:57.031251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6a5d8b9d-e82a-4ee7-9b5d-9efa81a899c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:34:57.154422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d8b9d-e82a-4ee7-9b5d-9efa81a899c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:34:57.155908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5d8b9d-e82a-4ee7-9b5d-9efa81a899c1 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:34:57.175351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 747/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:35:06.787339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=22 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:07.173716 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=66 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:16.790890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735e4b0-e342-4b39-9dea-c3fab2885fc5 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:16.791469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735e4b0-e342-4b39-9dea-c3fab2885fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:16.791469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735e4b0-e342-4b39-9dea-c3fab2885fc5 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:16.792955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 724/1471] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:35:16.798548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b6699-7a4d-4051-a571-0189243eca7a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:16.799031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b6699-7a4d-4051-a571-0189243eca7a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:16.799140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b6699-7a4d-4051-a571-0189243eca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:16.865095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9f8b6699-7a4d-4051-a571-0189243eca7a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:35:16.866318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9f8b6699-7a4d-4051-a571-0189243eca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:16.965545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 748/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:35:17.049715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626634c4-5bfc-436f-b767-31a18195ea07 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:17.050011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626634c4-5bfc-436f-b767-31a18195ea07 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:17.050281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626634c4-5bfc-436f-b767-31a18195ea07 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:17.051840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 725/1473] 10.222.0.64 () {54 vars in 962 bytes} [Tue Jul 12 13:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:35:17.056942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c082b88-709b-48a5-9bf3-dfd80255b556 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:17.057227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c082b88-709b-48a5-9bf3-dfd80255b556 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:17.057532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c082b88-709b-48a5-9bf3-dfd80255b556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:17.134567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5c082b88-709b-48a5-9bf3-dfd80255b556 None None] MFA Rules not processed for user `b1dd830b8f7846e78d8f007ac436d95b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:35:17.135844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5c082b88-709b-48a5-9bf3-dfd80255b556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:17.158216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:17.215169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 749/1474] 10.222.0.64 () {58 vars in 1059 bytes} [Tue Jul 12 13:35:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:35:17.223466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626634c4-5bfc-436f-b767-31a18195ea07 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:35:17.224621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-626634c4-5bfc-436f-b767-31a18195ea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:17.336507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626634c4-5bfc-436f-b767-31a18195ea07 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:35:17.413074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf742aa-2abb-49d1-8f18-aa61a3e30710 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:35:17.413744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf742aa-2abb-49d1-8f18-aa61a3e30710 service glance] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:17.414025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf742aa-2abb-49d1-8f18-aa61a3e30710 service glance] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:17.414310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf742aa-2abb-49d1-8f18-aa61a3e30710 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:17.416013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9bf742aa-2abb-49d1-8f18-aa61a3e30710 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:17.474047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:17.530975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf742aa-2abb-49d1-8f18-aa61a3e30710 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:35:17.532486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf742aa-2abb-49d1-8f18-aa61a3e30710 service glance] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:35:17.552883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 726/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:19.652801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2984-cb83-4e24-99e2-e4e64e5787ee None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:19.653511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2984-cb83-4e24-99e2-e4e64e5787ee None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:19.653511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe2984-cb83-4e24-99e2-e4e64e5787ee None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:19.654977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 750/1476] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:35:19.662322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c30051-b652-4640-88c9-48077f704a98 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:19.662789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c30051-b652-4640-88c9-48077f704a98 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:19.662894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c30051-b652-4640-88c9-48077f704a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:19.738329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f2c30051-b652-4640-88c9-48077f704a98 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:35:19.739545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f2c30051-b652-4640-88c9-48077f704a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:19.841589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 727/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:35:19.865891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe2984-cb83-4e24-99e2-e4e64e5787ee None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:35:19.867439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-62fe2984-cb83-4e24-99e2-e4e64e5787ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:19.998068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe2984-cb83-4e24-99e2-e4e64e5787ee None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:35:20.047522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:20.097531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ea32a-f114-4472-90ca-e2dafe904f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:35:20.102592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea32a-f114-4472-90ca-e2dafe904f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:20.103138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea32a-f114-4472-90ca-e2dafe904f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:20.104923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea32a-f114-4472-90ca-e2dafe904f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:20.106227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ea32a-f114-4472-90ca-e2dafe904f05 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:35:20.108183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-969ea32a-f114-4472-90ca-e2dafe904f05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:35:20.108183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: warnings.warn(msg) Jul 12 13:35:20.108183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: Jul 12 13:35:20.109320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969ea32a-f114-4472-90ca-e2dafe904f05 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:35:20.129773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 751/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Tue Jul 12 13:35:19 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:35:22.176598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ab43-2fda-46a2-91b0-d43ef205c027 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:22.177450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ab43-2fda-46a2-91b0-d43ef205c027 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:22.177450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284ab43-2fda-46a2-91b0-d43ef205c027 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:22.179672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 728/1479] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:35:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:35:22.188825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2c5b-f04a-456a-ba6a-21605ce2d7f1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:22.189271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2c5b-f04a-456a-ba6a-21605ce2d7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:22.189400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da2c5b-f04a-456a-ba6a-21605ce2d7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:22.261503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-95da2c5b-f04a-456a-ba6a-21605ce2d7f1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:35:22.262749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-95da2c5b-f04a-456a-ba6a-21605ce2d7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:22.364010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 752/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:35:22.407421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284ab43-2fda-46a2-91b0-d43ef205c027 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:35:22.409054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d284ab43-2fda-46a2-91b0-d43ef205c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:22.419452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:22.570512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284ab43-2fda-46a2-91b0-d43ef205c027 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:35:22.666604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:22.701057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c53bb-9f62-4be9-8d43-4ee3073fb009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:35:22.701710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c53bb-9f62-4be9-8d43-4ee3073fb009 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:22.701995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c53bb-9f62-4be9-8d43-4ee3073fb009 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:22.702269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c53bb-9f62-4be9-8d43-4ee3073fb009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:22.704025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-218c53bb-9f62-4be9-8d43-4ee3073fb009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:22.795290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c53bb-9f62-4be9-8d43-4ee3073fb009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:35:22.796926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c53bb-9f62-4be9-8d43-4ee3073fb009 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:35:22.817072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 729/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:35:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:24.985325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe552-9b61-4881-a00f-516d2f2d8fe9 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:24.985878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe552-9b61-4881-a00f-516d2f2d8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:24.985878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fe552-9b61-4881-a00f-516d2f2d8fe9 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:24.988146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 753/1482] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:35:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:35:24.996200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbca21-0cec-4a31-8ecd-e4807fe95120 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:24.996672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbca21-0cec-4a31-8ecd-e4807fe95120 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:24.996776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfbca21-0cec-4a31-8ecd-e4807fe95120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:25.066191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ecfbca21-0cec-4a31-8ecd-e4807fe95120 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:35:25.067421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ecfbca21-0cec-4a31-8ecd-e4807fe95120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:25.114718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:25.167161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 730/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:35:25.202824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe552-9b61-4881-a00f-516d2f2d8fe9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:35:25.204433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1b9fe552-9b61-4881-a00f-516d2f2d8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:25.228769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:25.316750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fe552-9b61-4881-a00f-516d2f2d8fe9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:35:25.402925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89c8bc-6334-4001-8858-f58c07e8d2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:35:25.403588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89c8bc-6334-4001-8858-f58c07e8d2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:25.403903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89c8bc-6334-4001-8858-f58c07e8d2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:25.404183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89c8bc-6334-4001-8858-f58c07e8d2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:25.405865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-af89c8bc-6334-4001-8858-f58c07e8d2a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:25.486699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:25.525678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89c8bc-6334-4001-8858-f58c07e8d2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:35:25.527098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af89c8bc-6334-4001-8858-f58c07e8d2a3 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:35:25.547544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 754/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:27.611287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0797e3-c28f-4155-87f1-b35561ea423e None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:27.611875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0797e3-c28f-4155-87f1-b35561ea423e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:27.611875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0797e3-c28f-4155-87f1-b35561ea423e None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:27.613551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 731/1485] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:35:27.618874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beaaf7-ab5f-4432-a12f-c5090d2c8b14 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:27.619361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beaaf7-ab5f-4432-a12f-c5090d2c8b14 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:27.619459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24beaaf7-ab5f-4432-a12f-c5090d2c8b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:27.690793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-24beaaf7-ab5f-4432-a12f-c5090d2c8b14 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:35:27.692409 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-24beaaf7-ab5f-4432-a12f-c5090d2c8b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:27.791936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 755/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:35:27.830411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0797e3-c28f-4155-87f1-b35561ea423e None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:35:27.832250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fe0797e3-c28f-4155-87f1-b35561ea423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:27.947187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0797e3-c28f-4155-87f1-b35561ea423e None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:35:28.023767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:28.025664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36727aad-41ab-4f44-9198-2868163c1914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:35:28.026426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727aad-41ab-4f44-9198-2868163c1914 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:28.026715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727aad-41ab-4f44-9198-2868163c1914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:28.027000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727aad-41ab-4f44-9198-2868163c1914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:28.029250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-36727aad-41ab-4f44-9198-2868163c1914 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:28.142108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36727aad-41ab-4f44-9198-2868163c1914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:35:28.143488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36727aad-41ab-4f44-9198-2868163c1914 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:35:28.163579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 732/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:30.265373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1ba6-94fd-4b41-a077-f6191cc5dc26 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:30.266261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1ba6-94fd-4b41-a077-f6191cc5dc26 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:30.266261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1ba6-94fd-4b41-a077-f6191cc5dc26 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:30.268709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 756/1488] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:35:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:35:30.274791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5141-7a5b-484d-9e2d-66b2913879d5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:30.275278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5141-7a5b-484d-9e2d-66b2913879d5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:30.275372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca5141-7a5b-484d-9e2d-66b2913879d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:30.349259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-97ca5141-7a5b-484d-9e2d-66b2913879d5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:35:30.350477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-97ca5141-7a5b-484d-9e2d-66b2913879d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:30.405588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:30.461782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 733/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:35:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:35:30.511757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a1ba6-94fd-4b41-a077-f6191cc5dc26 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:35:30.513302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-546a1ba6-94fd-4b41-a077-f6191cc5dc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:30.551631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:30.622726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a1ba6-94fd-4b41-a077-f6191cc5dc26 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:35:30.704430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa526b-d453-4027-87a3-aaec5a359a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:35:30.705085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa526b-d453-4027-87a3-aaec5a359a8d service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:30.705367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa526b-d453-4027-87a3-aaec5a359a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:30.705641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa526b-d453-4027-87a3-aaec5a359a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:30.707302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-77aa526b-d453-4027-87a3-aaec5a359a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:30.792757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:30.825721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa526b-d453-4027-87a3-aaec5a359a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:35:30.827194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa526b-d453-4027-87a3-aaec5a359a8d service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:35:30.846481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 757/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:33.029020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab769808-f3ca-4f7c-ace0-d3989859d3e4 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:33.029887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab769808-f3ca-4f7c-ace0-d3989859d3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:33.029887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab769808-f3ca-4f7c-ace0-d3989859d3e4 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:33.032368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 734/1491] 10.222.0.64 () {54 vars in 926 bytes} [Tue Jul 12 13:35:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:35:33.037808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399cbb-efcd-42ba-b7fc-1c46b9875483 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:33.038259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399cbb-efcd-42ba-b7fc-1c46b9875483 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:33.038366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8399cbb-efcd-42ba-b7fc-1c46b9875483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:33.107440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-f8399cbb-efcd-42ba-b7fc-1c46b9875483 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:35:33.108681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f8399cbb-efcd-42ba-b7fc-1c46b9875483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:33.205935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 758/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Tue Jul 12 13:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:35:33.247042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab769808-f3ca-4f7c-ace0-d3989859d3e4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:35:33.248652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ab769808-f3ca-4f7c-ace0-d3989859d3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:33.480106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab769808-f3ca-4f7c-ace0-d3989859d3e4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:35:33.556770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d9ca1-2f87-4b30-8a47-97daf3863944 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:35:33.557422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d9ca1-2f87-4b30-8a47-97daf3863944 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:35:33.557697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d9ca1-2f87-4b30-8a47-97daf3863944 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:35:33.557966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d9ca1-2f87-4b30-8a47-97daf3863944 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:35:33.559588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-665d9ca1-2f87-4b30-8a47-97daf3863944 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:35:33.568986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:33.678879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d9ca1-2f87-4b30-8a47-97daf3863944 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:35:33.680390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665d9ca1-2f87-4b30-8a47-97daf3863944 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:35:33.699575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 735/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:35:43.204225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=82 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:35:43.696889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=50 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:24.499760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76a19-f679-4ed8-9714-15953e45de1c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:24.500760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76a19-f679-4ed8-9714-15953e45de1c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:24.500760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c76a19-f679-4ed8-9714-15953e45de1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:24.581688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a4c76a19-f679-4ed8-9714-15953e45de1c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:37:24.582933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a4c76a19-f679-4ed8-9714-15953e45de1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:24.681363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 759/1494] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:37:24.690120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3eea-e7e2-48ba-9091-7852912d621c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:24.690636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3eea-e7e2-48ba-9091-7852912d621c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:24.690636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd3eea-e7e2-48ba-9091-7852912d621c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:24.766037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5bfd3eea-e7e2-48ba-9091-7852912d621c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:37:24.767187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5bfd3eea-e7e2-48ba-9091-7852912d621c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:24.868429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 736/1495] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:37:24.873747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c76a19-f679-4ed8-9714-15953e45de1c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:24.874977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a4c76a19-f679-4ed8-9714-15953e45de1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:24.887408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c76a19-f679-4ed8-9714-15953e45de1c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:24.955575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:24.991659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:24.992350 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:24.992628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:24.992897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:24.993635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:37:24.993943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:24.994964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:37:24.994964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: warnings.warn(msg) Jul 12 13:37:24.994964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: Jul 12 13:37:24.995863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:25.007638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 760/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:37:25.017994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3eea-e7e2-48ba-9091-7852912d621c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:25.029265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd3eea-e7e2-48ba-9091-7852912d621c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:25.108413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:25.146823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:25.147510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:25.147833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:25.148105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:25.148796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:25.150559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING py.warnings [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:37:25.150559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: warnings.warn(msg) Jul 12 13:37:25.150559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: Jul 12 13:37:25.151764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:25.210824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 737/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:37:25 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:37:25.215279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:25.216894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:25.249942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b430da-66b3-4269-977b-2075db1ceef2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:25.347464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:25.348192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:25.348439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:25.348711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:25.349398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:25.350415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:37:25.350415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: warnings.warn(msg) Jul 12 13:37:25.350415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: Jul 12 13:37:25.351632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:25.396714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 761/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:37:25 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:37:25.401358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:25.402892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:25.470518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f52fb-a345-4331-bc26-37b315dfdd65 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:25.560872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:25.579037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:25.579779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:25.580043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:25.580314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:25.581054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:25.582080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING py.warnings [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:37:25.582080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: warnings.warn(msg) Jul 12 13:37:25.582080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: Jul 12 13:37:25.582963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:25.595950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 738/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:37:25.600450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:25.601956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:25.613858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d49fa-537b-4cf8-a05f-cbb842036f47 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:25.640562 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:25.713025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb7fea-f9a6-4989-896d-33197b33e0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:25.713708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7fea-f9a6-4989-896d-33197b33e0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:25.713983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7fea-f9a6-4989-896d-33197b33e0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:25.714256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb7fea-f9a6-4989-896d-33197b33e0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:25.715038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb7fea-f9a6-4989-896d-33197b33e0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:25.716086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-76eb7fea-f9a6-4989-896d-33197b33e0d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:37:25.716086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: warnings.warn(msg) Jul 12 13:37:25.716086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: Jul 12 13:37:25.717017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eb7fea-f9a6-4989-896d-33197b33e0d3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:25.729766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 762/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:37:25.734351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:25.735990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:25.771743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f7f12-9a26-4640-ab17-d15f37a9cb29 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:25.877476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc879ad9-6c9b-4622-969d-0b75531b4885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:25.878315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc879ad9-6c9b-4622-969d-0b75531b4885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:25.878596 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc879ad9-6c9b-4622-969d-0b75531b4885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:25.878874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc879ad9-6c9b-4622-969d-0b75531b4885 admin admin] PATH_INFO: `/v3/projects/7f1232081aa94b6f814b31fdf44be04b/users/71bced75f63c48f6bcb6207732356da9/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:25.904466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc879ad9-6c9b-4622-969d-0b75531b4885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f1232081aa94b6f814b31fdf44be04b, user_id=71bced75f63c48f6bcb6207732356da9, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:25.905515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING py.warnings [None req-dc879ad9-6c9b-4622-969d-0b75531b4885 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:37:25.905515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: warnings.warn(msg) Jul 12 13:37:25.905515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: Jul 12 13:37:25.907474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc879ad9-6c9b-4622-969d-0b75531b4885 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:25.934299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 739/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:37:25 2022] PUT /identity/v3/projects/7f1232081aa94b6f814b31fdf44be04b/users/71bced75f63c48f6bcb6207732356da9/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:37:25.946915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ed12-8ca9-44f3-a7c1-ad372b96b09c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:25.947205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ed12-8ca9-44f3-a7c1-ad372b96b09c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:25.947483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906ed12-8ca9-44f3-a7c1-ad372b96b09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:26.006319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8906ed12-8ca9-44f3-a7c1-ad372b96b09c None None] MFA Rules not processed for user `71bced75f63c48f6bcb6207732356da9`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:37:26.007556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8906ed12-8ca9-44f3-a7c1-ad372b96b09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:26.086488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 763/1502] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:37:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:37:26.105603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524dd7-a716-475f-90aa-8462e414037d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:26.105897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524dd7-a716-475f-90aa-8462e414037d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:26.106171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f524dd7-a716-475f-90aa-8462e414037d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:26.107577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 740/1503] 10.222.0.64 () {54 vars in 963 bytes} [Tue Jul 12 13:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:37:26.112534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134da13-d87b-4c9b-9697-f36890fc40f6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:26.112825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134da13-d87b-4c9b-9697-f36890fc40f6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:26.113104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134da13-d87b-4c9b-9697-f36890fc40f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:26.144453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:26.189806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8134da13-d87b-4c9b-9697-f36890fc40f6 None None] MFA Rules not processed for user `1df6ff57287645b2ae6f3b68543d6fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:37:26.191006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8134da13-d87b-4c9b-9697-f36890fc40f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:26.274386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 764/1504] 10.222.0.64 () {58 vars in 1060 bytes} [Tue Jul 12 13:37:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:37:26.283972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f524dd7-a716-475f-90aa-8462e414037d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:26.285498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9f524dd7-a716-475f-90aa-8462e414037d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:26.337861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:26.392909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f524dd7-a716-475f-90aa-8462e414037d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:26.473886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:26.474463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:26.474745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:26.475017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:26.476700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:26.593226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:26.594665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:26.598166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:26.613741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 741/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:37:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:37:26.657850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3851-7b04-43e5-9e40-0432155fb038 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:26.658314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3851-7b04-43e5-9e40-0432155fb038 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:26.658428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3851-7b04-43e5-9e40-0432155fb038 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:26.659734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 765/1506] 10.222.0.64 () {52 vars in 829 bytes} [Tue Jul 12 13:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:37:26.663330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:26.664593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:26.769071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d417081-0b8e-47bd-8c31-48a8deeb729f service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:26.896221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:26.897113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:26.897393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:26.897671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] PATH_INFO: `/v3/users/71bced75f63c48f6bcb6207732356da9` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:26.911184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71bced75f63c48f6bcb6207732356da9)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:26.912263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING py.warnings [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:37:26.912263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: warnings.warn(msg) Jul 12 13:37:26.912263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: Jul 12 13:37:26.913469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:26.923556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:26.981284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71bced75f63c48f6bcb6207732356da9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:26.992417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71bced75f63c48f6bcb6207732356da9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:26.992858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71bced75f63c48f6bcb6207732356da9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:27.005437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71bced75f63c48f6bcb6207732356da9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:27.023762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71bced75f63c48f6bcb6207732356da9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:27.029824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 742/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:37:26 2022] DELETE /identity/v3/users/71bced75f63c48f6bcb6207732356da9 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:37:27.034411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4cf0-56b6-4d84-a31b-82d04313636f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:27.034695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4cf0-56b6-4d84-a31b-82d04313636f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:27.034973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4cf0-56b6-4d84-a31b-82d04313636f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:27.091362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-794f4cf0-56b6-4d84-a31b-82d04313636f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:37:27.092654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-794f4cf0-56b6-4d84-a31b-82d04313636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:27.166832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:27.182636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 766/1508] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:37:27.195046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:27.196354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:27.312258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05da4c3-1955-4ffe-bd92-b150e64de022 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:27.375744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:27.396772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c61b-5c53-4e8b-9cae-1d34cd694a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:27.397435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c61b-5c53-4e8b-9cae-1d34cd694a9e service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:27.397729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c61b-5c53-4e8b-9cae-1d34cd694a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:27.397996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c61b-5c53-4e8b-9cae-1d34cd694a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:27.399708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-05d3c61b-5c53-4e8b-9cae-1d34cd694a9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:27.521127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c61b-5c53-4e8b-9cae-1d34cd694a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:27.522597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c61b-5c53-4e8b-9cae-1d34cd694a9e service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:27.547358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 743/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:37:27.888668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4cf0-56b6-4d84-a31b-82d04313636f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:37:27.889867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-794f4cf0-56b6-4d84-a31b-82d04313636f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:37:27.901564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4cf0-56b6-4d84-a31b-82d04313636f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:37:28.000155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:37:28.001177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:37:28.001527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:37:28.001912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] PATH_INFO: `/v3/projects/7f1232081aa94b6f814b31fdf44be04b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:37:28.011824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f1232081aa94b6f814b31fdf44be04b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:37:28.012886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:37:28.012886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: warnings.warn(msg) Jul 12 13:37:28.012886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: Jul 12 13:37:28.014152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:37:28.079223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f1232081aa94b6f814b31fdf44be04b', 'request_id': 'req-54db1eae-07f7-422f-8dfb-ed809e94b764'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:28.100011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f1232081aa94b6f814b31fdf44be04b', 'request_id': 'req-54db1eae-07f7-422f-8dfb-ed809e94b764'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:28.110060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f1232081aa94b6f814b31fdf44be04b', 'request_id': 'req-54db1eae-07f7-422f-8dfb-ed809e94b764'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:28.132442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] The token cache is being invalidate because project 7f1232081aa94b6f814b31fdf44be04b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:37:28.132728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:28.133248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-54db1eae-07f7-422f-8dfb-ed809e94b764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:37:28.134657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 767/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:37:27 2022] DELETE /identity/v3/projects/7f1232081aa94b6f814b31fdf44be04b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:37:37.544770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=62 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:37:38.130386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:39:16.538267 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd296a-b59a-44a5-9ec0-6dfbf162fc1a None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:16.538907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd296a-b59a-44a5-9ec0-6dfbf162fc1a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:16.538907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd296a-b59a-44a5-9ec0-6dfbf162fc1a None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:16.541152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:39:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:16.547230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a4910-690a-41e9-aaab-62c7397739f0 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:16.547693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a4910-690a-41e9-aaab-62c7397739f0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:16.548046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a4910-690a-41e9-aaab-62c7397739f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:16.637923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c39a4910-690a-41e9-aaab-62c7397739f0 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:16.639845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c39a4910-690a-41e9-aaab-62c7397739f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:16.758797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:16.927568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd296a-b59a-44a5-9ec0-6dfbf162fc1a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:16.931019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ebbd296a-b59a-44a5-9ec0-6dfbf162fc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:17.067937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd296a-b59a-44a5-9ec0-6dfbf162fc1a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:17.075361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbf4957-af47-4b7d-ab59-37709aa513b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:17.076055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4957-af47-4b7d-ab59-37709aa513b1 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:17.076334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4957-af47-4b7d-ab59-37709aa513b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:17.076603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbf4957-af47-4b7d-ab59-37709aa513b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:17.086228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4957-af47-4b7d-ab59-37709aa513b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:17.088697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbf4957-af47-4b7d-ab59-37709aa513b1 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:17.100458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 745/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:17.976182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66685-b805-4157-a191-1931aa94b7f9 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:17.976787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66685-b805-4157-a191-1931aa94b7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:17.976787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e66685-b805-4157-a191-1931aa94b7f9 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:17.978131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 769/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:17.984435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef148f9-2c1b-4757-a244-e528a6ad4a06 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:17.985158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef148f9-2c1b-4757-a244-e528a6ad4a06 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:17.985263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef148f9-2c1b-4757-a244-e528a6ad4a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:18.006345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-cef148f9-2c1b-4757-a244-e528a6ad4a06 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:18.007592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cef148f9-2c1b-4757-a244-e528a6ad4a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:18.016050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 746/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:18.164474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c694-ae9c-4026-91c0-21437c036c3f None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:18.164839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c694-ae9c-4026-91c0-21437c036c3f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:18.165040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c694-ae9c-4026-91c0-21437c036c3f None None] PATH_INFO: `/v3` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:18.166380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 770/1516] 10.222.0.67 () {54 vars in 925 bytes} [Tue Jul 12 13:39:18 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:39:18.171624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef148f9-2c1b-4757-a244-e528a6ad4a06 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:18.172407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd12dd-da09-4534-a77d-21bb6e15760f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:18.172692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd12dd-da09-4534-a77d-21bb6e15760f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:18.173083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bd12dd-da09-4534-a77d-21bb6e15760f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:18.185013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef148f9-2c1b-4757-a244-e528a6ad4a06 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:18.191391 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2224a86-92a7-40c8-a7fb-1e0a5ec0e06b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:18.192103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2224a86-92a7-40c8-a7fb-1e0a5ec0e06b service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:18.192362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2224a86-92a7-40c8-a7fb-1e0a5ec0e06b service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:18.192645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2224a86-92a7-40c8-a7fb-1e0a5ec0e06b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:18.201767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2224a86-92a7-40c8-a7fb-1e0a5ec0e06b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:18.203390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2224a86-92a7-40c8-a7fb-1e0a5ec0e06b service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:18.213287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 747/1517] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:18.237240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b4bd12dd-da09-4534-a77d-21bb6e15760f None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:18.238379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b4bd12dd-da09-4534-a77d-21bb6e15760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:18.272728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:39:18.323950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 771/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Tue Jul 12 13:39:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:27.516372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30d987-04d9-4e76-8289-decd041a9d82 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:27.517281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30d987-04d9-4e76-8289-decd041a9d82 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:27.517281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30d987-04d9-4e76-8289-decd041a9d82 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:27.519279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 748/1519] 10.222.0.64 () {54 vars in 960 bytes} [Tue Jul 12 13:39:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:27.527673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80faed-e964-4e51-a286-3bf1a93856a9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:27.528107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80faed-e964-4e51-a286-3bf1a93856a9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:27.528216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80faed-e964-4e51-a286-3bf1a93856a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:27.551180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ab80faed-e964-4e51-a286-3bf1a93856a9 None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:27.552432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ab80faed-e964-4e51-a286-3bf1a93856a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:27.562654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 772/1520] 10.222.0.64 () {58 vars in 1057 bytes} [Tue Jul 12 13:39:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:27.570631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30d987-04d9-4e76-8289-decd041a9d82 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:27.585169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30d987-04d9-4e76-8289-decd041a9d82 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:27.590918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e62ff0-df7c-4e1c-b1bf-27c977df997f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:27.591545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62ff0-df7c-4e1c-b1bf-27c977df997f service placement] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:27.591864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62ff0-df7c-4e1c-b1bf-27c977df997f service placement] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:27.592156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62ff0-df7c-4e1c-b1bf-27c977df997f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:27.601578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e62ff0-df7c-4e1c-b1bf-27c977df997f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:27.603244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e62ff0-df7c-4e1c-b1bf-27c977df997f service placement] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:27.613898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 749/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:29.449250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eaff5-fc36-4a31-aad7-34cde372f275 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:29.449842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eaff5-fc36-4a31-aad7-34cde372f275 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:29.449842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587eaff5-fc36-4a31-aad7-34cde372f275 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:29.451202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 773/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:29.456665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164e68d-015b-47ac-9369-8512a8893414 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:29.457100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164e68d-015b-47ac-9369-8512a8893414 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:29.457196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164e68d-015b-47ac-9369-8512a8893414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:29.475957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-a164e68d-015b-47ac-9369-8512a8893414 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:29.477154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a164e68d-015b-47ac-9369-8512a8893414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:29.485550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 750/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:29.640236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eaff5-fc36-4a31-aad7-34cde372f275 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:29.656022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587eaff5-fc36-4a31-aad7-34cde372f275 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:29.664072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a79305-204c-4a63-b269-8caf9d01a3fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:29.665063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a79305-204c-4a63-b269-8caf9d01a3fd service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:29.665492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a79305-204c-4a63-b269-8caf9d01a3fd service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:29.665913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a79305-204c-4a63-b269-8caf9d01a3fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:29.675185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a79305-204c-4a63-b269-8caf9d01a3fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:29.676820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a79305-204c-4a63-b269-8caf9d01a3fd service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:29.688908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 774/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:30.500562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801499ba-94b7-4063-9a92-ccee3fd0a579 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:30.501146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801499ba-94b7-4063-9a92-ccee3fd0a579 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:30.501146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801499ba-94b7-4063-9a92-ccee3fd0a579 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:30.503168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 751/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 13:39:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:30.508844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426ff90-d8ff-4b54-a541-fa285608dafc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:30.509266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426ff90-d8ff-4b54-a541-fa285608dafc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:30.509460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426ff90-d8ff-4b54-a541-fa285608dafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:30.527908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c426ff90-d8ff-4b54-a541-fa285608dafc None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:30.529122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c426ff90-d8ff-4b54-a541-fa285608dafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:30.537741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 775/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 13:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:30.689866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801499ba-94b7-4063-9a92-ccee3fd0a579 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:30.706242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801499ba-94b7-4063-9a92-ccee3fd0a579 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:30.712224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a800e-4a9b-40f5-bd61-5af2bd355330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:30.712966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a800e-4a9b-40f5-bd61-5af2bd355330 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:30.713250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a800e-4a9b-40f5-bd61-5af2bd355330 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:30.713526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a800e-4a9b-40f5-bd61-5af2bd355330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:30.721619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a800e-4a9b-40f5-bd61-5af2bd355330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:30.723199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a800e-4a9b-40f5-bd61-5af2bd355330 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:30.732728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 752/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:35.580732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097a559-60ee-436b-9e06-c4b617864cf3 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:35.581328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097a559-60ee-436b-9e06-c4b617864cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:35.581328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097a559-60ee-436b-9e06-c4b617864cf3 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:35.582677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 776/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:35.589106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e0e9-98c3-406c-9bb9-46d326d02e89 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:35.589550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e0e9-98c3-406c-9bb9-46d326d02e89 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:35.589703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d806e0e9-98c3-406c-9bb9-46d326d02e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:35.613550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d806e0e9-98c3-406c-9bb9-46d326d02e89 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:35.614763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d806e0e9-98c3-406c-9bb9-46d326d02e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:35.624893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 753/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:39:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:35.701353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097a559-60ee-436b-9e06-c4b617864cf3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:35.703312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5097a559-60ee-436b-9e06-c4b617864cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:35.785679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097a559-60ee-436b-9e06-c4b617864cf3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:35.790114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643d0d9-1a02-4a7f-9221-a4d8fb2a5f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:35.790768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d0d9-1a02-4a7f-9221-a4d8fb2a5f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:35.791052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d0d9-1a02-4a7f-9221-a4d8fb2a5f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:35.791332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d0d9-1a02-4a7f-9221-a4d8fb2a5f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:35.800957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643d0d9-1a02-4a7f-9221-a4d8fb2a5f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:35.802398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643d0d9-1a02-4a7f-9221-a4d8fb2a5f58 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:35.811897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 777/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:37.833130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a0a6d-e863-483f-903e-57de497a2429 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:37.833998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a0a6d-e863-483f-903e-57de497a2429 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:37.833998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a0a6d-e863-483f-903e-57de497a2429 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:37.836186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 754/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:39:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:37.842220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc5515-fd78-4dd2-aa74-2b5bcac417f1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:37.842675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc5515-fd78-4dd2-aa74-2b5bcac417f1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:37.842773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc5515-fd78-4dd2-aa74-2b5bcac417f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:37.862410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-11bc5515-fd78-4dd2-aa74-2b5bcac417f1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:37.863778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-11bc5515-fd78-4dd2-aa74-2b5bcac417f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:37.873144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 778/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:37.911939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a0a6d-e863-483f-903e-57de497a2429 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:37.918433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=81 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:39:37.926520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a0a6d-e863-483f-903e-57de497a2429 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:37.932649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40628222-7d25-4ad8-aac4-3977381acee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:37.933300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40628222-7d25-4ad8-aac4-3977381acee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:37.933585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40628222-7d25-4ad8-aac4-3977381acee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:37.933860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40628222-7d25-4ad8-aac4-3977381acee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:37.943626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40628222-7d25-4ad8-aac4-3977381acee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:37.945087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40628222-7d25-4ad8-aac4-3977381acee7 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:37.954662 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 755/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:41.740489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c579-b3c9-47f6-af0c-52aa7df1e65b None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:41.741334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c579-b3c9-47f6-af0c-52aa7df1e65b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:41.741501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3c579-b3c9-47f6-af0c-52aa7df1e65b None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:41.743777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 779/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:39:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:41.749538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d15549-1f09-43da-b2bb-9783944302fa None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:41.749969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d15549-1f09-43da-b2bb-9783944302fa None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:41.750062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d15549-1f09-43da-b2bb-9783944302fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:41.768566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-05d15549-1f09-43da-b2bb-9783944302fa None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:41.769774 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-05d15549-1f09-43da-b2bb-9783944302fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:41.778079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 756/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:42.078940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3c579-b3c9-47f6-af0c-52aa7df1e65b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:42.081094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9bc3c579-b3c9-47f6-af0c-52aa7df1e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:42.165648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3c579-b3c9-47f6-af0c-52aa7df1e65b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:42.169970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc2aafd-acb0-4c4e-a4cc-e4da21089915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:42.170615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2aafd-acb0-4c4e-a4cc-e4da21089915 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:42.170900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2aafd-acb0-4c4e-a4cc-e4da21089915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:42.171175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2aafd-acb0-4c4e-a4cc-e4da21089915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:42.178605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:39:42.181203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2aafd-acb0-4c4e-a4cc-e4da21089915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:42.182937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc2aafd-acb0-4c4e-a4cc-e4da21089915 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:42.193013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 780/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:44.239756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9718-e8ae-421e-ab2f-95187505dd29 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:44.240365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9718-e8ae-421e-ab2f-95187505dd29 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:44.240365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde9718-e8ae-421e-ab2f-95187505dd29 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:44.241697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 757/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 13:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:39:44.248099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2fc33-aad5-42cf-9a96-be88236be6c6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:44.248566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2fc33-aad5-42cf-9a96-be88236be6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:44.248717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2fc33-aad5-42cf-9a96-be88236be6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:44.271401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9cb2fc33-aad5-42cf-9a96-be88236be6c6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:39:44.272641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9cb2fc33-aad5-42cf-9a96-be88236be6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:44.281096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 781/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 13:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:39:44.581736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde9718-e8ae-421e-ab2f-95187505dd29 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:39:44.584870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-dbde9718-e8ae-421e-ab2f-95187505dd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:39:44.600922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde9718-e8ae-421e-ab2f-95187505dd29 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:39:44.604981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0b1ee3-7d69-472e-8118-1afad5d2e4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:39:44.605629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1ee3-7d69-472e-8118-1afad5d2e4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:39:44.605914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1ee3-7d69-472e-8118-1afad5d2e4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:39:44.606192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0b1ee3-7d69-472e-8118-1afad5d2e4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:39:44.615813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b1ee3-7d69-472e-8118-1afad5d2e4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:39:44.617244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0b1ee3-7d69-472e-8118-1afad5d2e4e7 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:39:44.626994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 758/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:39:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:39:54.266947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:39:54.622915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=14 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:21.906342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158ade0-07ad-4bf2-8075-a8b0736d0f20 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:21.906961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158ade0-07ad-4bf2-8075-a8b0736d0f20 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:21.906961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158ade0-07ad-4bf2-8075-a8b0736d0f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:21.935165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e158ade0-07ad-4bf2-8075-a8b0736d0f20 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:21.936410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e158ade0-07ad-4bf2-8075-a8b0736d0f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:21.949065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 782/1540] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:21.958801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fce8a-b920-46b8-bbde-0650529a0104 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:21.960046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fce8a-b920-46b8-bbde-0650529a0104 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:21.960573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fce8a-b920-46b8-bbde-0650529a0104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:21.989660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ba4fce8a-b920-46b8-bbde-0650529a0104 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:21.991282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ba4fce8a-b920-46b8-bbde-0650529a0104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.008033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 759/1541] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.013515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158ade0-07ad-4bf2-8075-a8b0736d0f20 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.025585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158ade0-07ad-4bf2-8075-a8b0736d0f20 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.037064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2b062-eb18-4a1b-8fb2-5ef0ac4fee50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.037822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2b062-eb18-4a1b-8fb2-5ef0ac4fee50 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.038142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2b062-eb18-4a1b-8fb2-5ef0ac4fee50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.038414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2b062-eb18-4a1b-8fb2-5ef0ac4fee50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.039189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2b062-eb18-4a1b-8fb2-5ef0ac4fee50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:22.039548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2b062-eb18-4a1b-8fb2-5ef0ac4fee50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.041563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2b062-eb18-4a1b-8fb2-5ef0ac4fee50 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.061036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 783/1542] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:22.069909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fce8a-b920-46b8-bbde-0650529a0104 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.085786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fce8a-b920-46b8-bbde-0650529a0104 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.086042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e731974-8133-4920-89ed-0661690f7623 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.086158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e731974-8133-4920-89ed-0661690f7623 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.086405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e731974-8133-4920-89ed-0661690f7623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.094124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd48f3-6918-456d-a3d2-206ed1095572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.095181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd48f3-6918-456d-a3d2-206ed1095572 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.095715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd48f3-6918-456d-a3d2-206ed1095572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.096294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd48f3-6918-456d-a3d2-206ed1095572 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.097612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd48f3-6918-456d-a3d2-206ed1095572 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.101176 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd48f3-6918-456d-a3d2-206ed1095572 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.112340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6e731974-8133-4920-89ed-0661690f7623 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.113556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6e731974-8133-4920-89ed-0661690f7623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.127883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 784/1543] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.137127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda604f-6c00-4ca5-bfe1-2705323a0318 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.137422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda604f-6c00-4ca5-bfe1-2705323a0318 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.137686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda604f-6c00-4ca5-bfe1-2705323a0318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.172319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-fbda604f-6c00-4ca5-bfe1-2705323a0318 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.173473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-fbda604f-6c00-4ca5-bfe1-2705323a0318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.178134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 760/1544] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:22.182908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd48f3-6918-456d-a3d2-206ed1095572 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.189979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 785/1545] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:22.195044 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda604f-6c00-4ca5-bfe1-2705323a0318 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.208031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda604f-6c00-4ca5-bfe1-2705323a0318 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.288690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd48f3-6918-456d-a3d2-206ed1095572 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.296086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.297185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.297680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.298167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.299056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.300378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING py.warnings [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:41:22.300378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: warnings.warn(msg) Jul 12 13:41:22.300378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: Jul 12 13:41:22.302886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.340168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 761/1546] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:41:22.346254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.356422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117acdcf-0fe8-4c84-bf2d-d2448ef00fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.357138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acdcf-0fe8-4c84-bf2d-d2448ef00fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.357427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acdcf-0fe8-4c84-bf2d-d2448ef00fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.357709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117acdcf-0fe8-4c84-bf2d-d2448ef00fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.358473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117acdcf-0fe8-4c84-bf2d-d2448ef00fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:22.358787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117acdcf-0fe8-4c84-bf2d-d2448ef00fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.359245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84061eda-d33f-4d8d-ad9f-544afa8fa878 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.363626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117acdcf-0fe8-4c84-bf2d-d2448ef00fc4 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.372289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de1ae-f7d3-4323-95e6-97086ef13d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.373396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de1ae-f7d3-4323-95e6-97086ef13d90 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.376014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de1ae-f7d3-4323-95e6-97086ef13d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.376602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143de1ae-f7d3-4323-95e6-97086ef13d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.377638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143de1ae-f7d3-4323-95e6-97086ef13d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.379719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143de1ae-f7d3-4323-95e6-97086ef13d90 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.394199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 786/1547] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:22.395671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881bff-9f0e-4e7e-925f-d4d73f8be13f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.395968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881bff-9f0e-4e7e-925f-d4d73f8be13f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.396250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0881bff-9f0e-4e7e-925f-d4d73f8be13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.400201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 762/1548] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:41:22.406781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de1ae-f7d3-4323-95e6-97086ef13d90 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.442519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143de1ae-f7d3-4323-95e6-97086ef13d90 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.459923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fcca2-2aa3-40f8-bb5b-bdf37439b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.460679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fcca2-2aa3-40f8-bb5b-bdf37439b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.460990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fcca2-2aa3-40f8-bb5b-bdf37439b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.461265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4fcca2-2aa3-40f8-bb5b-bdf37439b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.462867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a0881bff-9f0e-4e7e-925f-d4d73f8be13f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.464240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a0881bff-9f0e-4e7e-925f-d4d73f8be13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.472155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fcca2-2aa3-40f8-bb5b-bdf37439b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.473834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4fcca2-2aa3-40f8-bb5b-bdf37439b7e0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.495479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 787/1549] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.496428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0881bff-9f0e-4e7e-925f-d4d73f8be13f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.508964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 763/1550] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:22.514708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fcca2-2aa3-40f8-bb5b-bdf37439b7e0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.530140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0881bff-9f0e-4e7e-925f-d4d73f8be13f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.537168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4fcca2-2aa3-40f8-bb5b-bdf37439b7e0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.542305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9a308-8c1b-4f8e-b891-6a4f10165f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.543175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994d69e-7705-478d-bd4f-ce52c0ffa55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.543323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9a308-8c1b-4f8e-b891-6a4f10165f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.543525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9a308-8c1b-4f8e-b891-6a4f10165f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.543804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9a308-8c1b-4f8e-b891-6a4f10165f98 admin admin] PATH_INFO: `/v3/projects/d105517f5def4d1eb9229b9bcab9cadb/users/0b6134cfb9cf44a9bc86f6c639283b24/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.544642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d69e-7705-478d-bd4f-ce52c0ffa55c admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.545125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d69e-7705-478d-bd4f-ce52c0ffa55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.545609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d69e-7705-478d-bd4f-ce52c0ffa55c admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.546531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994d69e-7705-478d-bd4f-ce52c0ffa55c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.547814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-c994d69e-7705-478d-bd4f-ce52c0ffa55c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:41:22.547814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: warnings.warn(msg) Jul 12 13:41:22.547814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: Jul 12 13:41:22.549454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994d69e-7705-478d-bd4f-ce52c0ffa55c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.560932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9a308-8c1b-4f8e-b891-6a4f10165f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d105517f5def4d1eb9229b9bcab9cadb, user_id=0b6134cfb9cf44a9bc86f6c639283b24, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.563557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac9a308-8c1b-4f8e-b891-6a4f10165f98 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.591847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 764/1551] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:22 2022] PUT /identity/v3/projects/d105517f5def4d1eb9229b9bcab9cadb/users/0b6134cfb9cf44a9bc86f6c639283b24/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:41:22.593311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fd474-395e-4c9c-b52d-86179ca8721b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.593754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fd474-395e-4c9c-b52d-86179ca8721b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.594035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9fd474-395e-4c9c-b52d-86179ca8721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.601378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 788/1552] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:22.602898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f51e3-fab0-4eb2-9e75-fdefe2301f03 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.603240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f51e3-fab0-4eb2-9e75-fdefe2301f03 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.603585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f51e3-fab0-4eb2-9e75-fdefe2301f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.622175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-2e9fd474-395e-4c9c-b52d-86179ca8721b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.623572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2e9fd474-395e-4c9c-b52d-86179ca8721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.626846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5f8f51e3-fab0-4eb2-9e75-fdefe2301f03 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.628259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5f8f51e3-fab0-4eb2-9e75-fdefe2301f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.693709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 789/1553] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.695199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621b53-46ed-4279-9dca-0267c453b16c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.695583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621b53-46ed-4279-9dca-0267c453b16c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.696108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc621b53-46ed-4279-9dca-0267c453b16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.700463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 765/1554] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.701898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701498f7-2e25-4bbc-840c-8ee5ccad7bde None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.702182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701498f7-2e25-4bbc-840c-8ee5ccad7bde None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.702452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701498f7-2e25-4bbc-840c-8ee5ccad7bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.715644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:22.718057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-dc621b53-46ed-4279-9dca-0267c453b16c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.719402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dc621b53-46ed-4279-9dca-0267c453b16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.722140 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-701498f7-2e25-4bbc-840c-8ee5ccad7bde None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.724032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-701498f7-2e25-4bbc-840c-8ee5ccad7bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.727590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 790/1555] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.728874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5111a1-318c-49df-bfbe-7d569b7921ac None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.729161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5111a1-318c-49df-bfbe-7d569b7921ac None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.729443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5111a1-318c-49df-bfbe-7d569b7921ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.732708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 766/1556] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.740905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701498f7-2e25-4bbc-840c-8ee5ccad7bde None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.748864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5e5111a1-318c-49df-bfbe-7d569b7921ac None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.750076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5e5111a1-318c-49df-bfbe-7d569b7921ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.751433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701498f7-2e25-4bbc-840c-8ee5ccad7bde None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.756199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a953e-8b5d-435f-ba8f-b19c33faa9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.756881 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a953e-8b5d-435f-ba8f-b19c33faa9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.757164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a953e-8b5d-435f-ba8f-b19c33faa9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.757439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a953e-8b5d-435f-ba8f-b19c33faa9eb admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.757839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 791/1557] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.758137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a953e-8b5d-435f-ba8f-b19c33faa9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.759064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b065-16dc-46c3-a4ab-4ee48636a3e4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.759348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b065-16dc-46c3-a4ab-4ee48636a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.759643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1b065-16dc-46c3-a4ab-4ee48636a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.760120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a953e-8b5d-435f-ba8f-b19c33faa9eb admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.779285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-25a1b065-16dc-46c3-a4ab-4ee48636a3e4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.783132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 767/1558] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/users => generated 288 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:22.783284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-25a1b065-16dc-46c3-a4ab-4ee48636a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.783397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566161cc-b806-4241-a273-00cb20daeace None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.783397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566161cc-b806-4241-a273-00cb20daeace None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.783397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566161cc-b806-4241-a273-00cb20daeace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.791911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 792/1559] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.793557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e03e6-d04c-491f-85be-82aff01a9410 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.793851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e03e6-d04c-491f-85be-82aff01a9410 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.794131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e03e6-d04c-491f-85be-82aff01a9410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.800520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-566161cc-b806-4241-a273-00cb20daeace None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.801831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-566161cc-b806-4241-a273-00cb20daeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.809774 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 768/1560] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.810677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566161cc-b806-4241-a273-00cb20daeace None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.816577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0e5e03e6-d04c-491f-85be-82aff01a9410 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.818047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0e5e03e6-d04c-491f-85be-82aff01a9410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.820965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566161cc-b806-4241-a273-00cb20daeace None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.826603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0066fe-3f48-427d-8908-ba7aab71457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.826780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 793/1561] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.827775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0066fe-3f48-427d-8908-ba7aab71457a admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.828287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0066fe-3f48-427d-8908-ba7aab71457a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.828403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf112b-678d-496e-8c06-88d4b417d5c3 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.828767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0066fe-3f48-427d-8908-ba7aab71457a admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.828957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf112b-678d-496e-8c06-88d4b417d5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.829349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf112b-678d-496e-8c06-88d4b417d5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.829799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0066fe-3f48-427d-8908-ba7aab71457a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:22.830486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0066fe-3f48-427d-8908-ba7aab71457a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.831515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING py.warnings [None req-fe0066fe-3f48-427d-8908-ba7aab71457a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:41:22.831515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: warnings.warn(msg) Jul 12 13:41:22.831515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: Jul 12 13:41:22.833209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0066fe-3f48-427d-8908-ba7aab71457a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.842674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:22.846775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 769/1562] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:22.848187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0b9cd-78ad-42d1-af6b-e3291d7e7c6a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.848480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0b9cd-78ad-42d1-af6b-e3291d7e7c6a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.848775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0b9cd-78ad-42d1-af6b-e3291d7e7c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.849367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-88cf112b-678d-496e-8c06-88d4b417d5c3 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.850579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-88cf112b-678d-496e-8c06-88d4b417d5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.860476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 794/1563] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.861092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf112b-678d-496e-8c06-88d4b417d5c3 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.871810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0bc0b9cd-78ad-42d1-af6b-e3291d7e7c6a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.873055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0bc0b9cd-78ad-42d1-af6b-e3291d7e7c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.881936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 770/1564] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.882726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0b9cd-78ad-42d1-af6b-e3291d7e7c6a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.891908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0b9cd-78ad-42d1-af6b-e3291d7e7c6a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.896670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471cd8f-8353-4afd-b050-5f9947948abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.897324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471cd8f-8353-4afd-b050-5f9947948abc admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.897601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471cd8f-8353-4afd-b050-5f9947948abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.897875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471cd8f-8353-4afd-b050-5f9947948abc admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.898587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471cd8f-8353-4afd-b050-5f9947948abc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.900224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471cd8f-8353-4afd-b050-5f9947948abc admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.910572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 771/1565] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:22.911900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c746-b730-49f7-b523-5da5a3d90c74 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.912191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c746-b730-49f7-b523-5da5a3d90c74 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.912467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7c746-b730-49f7-b523-5da5a3d90c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.923987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf112b-678d-496e-8c06-88d4b417d5c3 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.927756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72c11-21ee-4d91-b19a-0129e4f735a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.928421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72c11-21ee-4d91-b19a-0129e4f735a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.928704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72c11-21ee-4d91-b19a-0129e4f735a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.928977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b72c11-21ee-4d91-b19a-0129e4f735a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.930418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-4db7c746-b730-49f7-b523-5da5a3d90c74 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.931632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4db7c746-b730-49f7-b523-5da5a3d90c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.938113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72c11-21ee-4d91-b19a-0129e4f735a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.939970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 772/1566] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.940088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b72c11-21ee-4d91-b19a-0129e4f735a8 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.941165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5cad5-b377-48db-bf1e-4d520b47be01 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.941451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5cad5-b377-48db-bf1e-4d520b47be01 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.941727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5cad5-b377-48db-bf1e-4d520b47be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.950128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 795/1567] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:22.950870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72c11-21ee-4d91-b19a-0129e4f735a8 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.959520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-eac5cad5-b377-48db-bf1e-4d520b47be01 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:22.960063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b72c11-21ee-4d91-b19a-0129e4f735a8 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.960745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-eac5cad5-b377-48db-bf1e-4d520b47be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:22.964986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.965685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.965969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.966245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.967015 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:22.967338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.969073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:22.969856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 773/1568] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:22.971129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5cad5-b377-48db-bf1e-4d520b47be01 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.981300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5cad5-b377-48db-bf1e-4d520b47be01 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:22.986203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 796/1569] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:22.986353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9282ac-9391-4672-8234-d72db1627413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:22.986952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9282ac-9391-4672-8234-d72db1627413 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:22.987349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9282ac-9391-4672-8234-d72db1627413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:22.987470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:22.987565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9282ac-9391-4672-8234-d72db1627413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:22.988221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9282ac-9391-4672-8234-d72db1627413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:22.990132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9282ac-9391-4672-8234-d72db1627413 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.005458 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78561d6-9831-4a46-908c-56d66ffdd334 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.011660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.012455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.012715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.013442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.014232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:23.014749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.016562 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.025025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 774/1570] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:22 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.025910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9282ac-9391-4672-8234-d72db1627413 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.035312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 797/1571] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:23.038475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.051491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01246588-e3e5-4223-8e78-fff739018ba0 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.110264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9282ac-9391-4672-8234-d72db1627413 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.115612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.116592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.116737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.116900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.117686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:23.118002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.119777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.120698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3832a1-f079-43dd-b560-fd4ca56f3470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.121449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3832a1-f079-43dd-b560-fd4ca56f3470 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.121736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3832a1-f079-43dd-b560-fd4ca56f3470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.122015 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3832a1-f079-43dd-b560-fd4ca56f3470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.122769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3832a1-f079-43dd-b560-fd4ca56f3470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.124442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3832a1-f079-43dd-b560-fd4ca56f3470 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.144469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 798/1572] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:23.144469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3832a1-f079-43dd-b560-fd4ca56f3470 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.148089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 775/1573] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:23.148089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.155545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0beb4c-2a28-40e6-bbac-e7dde72dcb72 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.159804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3832a1-f079-43dd-b560-fd4ca56f3470 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.162727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.163394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.163813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.164193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.164967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:23.165220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.165353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.165895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.166177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.166513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.167096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.167253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:23.167555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.169207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.187702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 776/1574] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:23.187702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.188016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 799/1575] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:23.188016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.198778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96c5a6-808e-4002-ab45-a71ef0532c06 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.202277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77aa055-19cf-4c6e-bf81-e2fede3c4940 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.206181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7db16-729d-432c-ac55-deb726b1eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.207314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7db16-729d-432c-ac55-deb726b1eda2 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.207429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f3a5a-277c-4d1d-8aa2-0b89c612b295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.207721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7db16-729d-432c-ac55-deb726b1eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.207941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7db16-729d-432c-ac55-deb726b1eda2 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.208113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3a5a-277c-4d1d-8aa2-0b89c612b295 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.208391 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3a5a-277c-4d1d-8aa2-0b89c612b295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.208638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7db16-729d-432c-ac55-deb726b1eda2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.208759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f3a5a-277c-4d1d-8aa2-0b89c612b295 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.209388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f3a5a-277c-4d1d-8aa2-0b89c612b295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.210620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7db16-729d-432c-ac55-deb726b1eda2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.211584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f3a5a-277c-4d1d-8aa2-0b89c612b295 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.235746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 800/1576] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/users => generated 285 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.236425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7db16-729d-432c-ac55-deb726b1eda2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.247374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 777/1577] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.248072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7db16-729d-432c-ac55-deb726b1eda2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.248907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f3a5a-277c-4d1d-8aa2-0b89c612b295 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.290321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:23.299369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:23.323085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471191-79a6-495b-b0f1-56d8c30993d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.323964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471191-79a6-495b-b0f1-56d8c30993d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.324241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471191-79a6-495b-b0f1-56d8c30993d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.324543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63471191-79a6-495b-b0f1-56d8c30993d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.325482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63471191-79a6-495b-b0f1-56d8c30993d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.327359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63471191-79a6-495b-b0f1-56d8c30993d8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.329169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f3a5a-277c-4d1d-8aa2-0b89c612b295 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.334069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecaa93-8532-4cd5-ab71-97bf5a84bb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.335192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecaa93-8532-4cd5-ab71-97bf5a84bb80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.335542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecaa93-8532-4cd5-ab71-97bf5a84bb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.335905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ecaa93-8532-4cd5-ab71-97bf5a84bb80 admin admin] PATH_INFO: `/v3/projects/f2e5aebea64a4bd0bf55ef95ee2b446c/users/0c10f3ffc56c4743b65e55a8936bc0cd/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.353309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecaa93-8532-4cd5-ab71-97bf5a84bb80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2e5aebea64a4bd0bf55ef95ee2b446c, user_id=0c10f3ffc56c4743b65e55a8936bc0cd, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.356303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ecaa93-8532-4cd5-ab71-97bf5a84bb80 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.363137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 801/1578] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.364330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471191-79a6-495b-b0f1-56d8c30993d8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.372097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 778/1579] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:23 2022] PUT /identity/v3/projects/f2e5aebea64a4bd0bf55ef95ee2b446c/users/0c10f3ffc56c4743b65e55a8936bc0cd/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:23.373003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecaa93-8532-4cd5-ab71-97bf5a84bb80 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.439829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63471191-79a6-495b-b0f1-56d8c30993d8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.445595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ecaa93-8532-4cd5-ab71-97bf5a84bb80 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.447729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac686-1ab4-4f28-be18-477f849b61f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.448578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac686-1ab4-4f28-be18-477f849b61f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.448761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac686-1ab4-4f28-be18-477f849b61f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.449044 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ac686-1ab4-4f28-be18-477f849b61f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.449929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ac686-1ab4-4f28-be18-477f849b61f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.452593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735ac686-1ab4-4f28-be18-477f849b61f6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.453633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17188c1c-3d75-4d6c-943e-de9c72b21a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.454380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17188c1c-3d75-4d6c-943e-de9c72b21a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.454664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17188c1c-3d75-4d6c-943e-de9c72b21a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.454988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17188c1c-3d75-4d6c-943e-de9c72b21a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.455729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17188c1c-3d75-4d6c-943e-de9c72b21a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.457883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17188c1c-3d75-4d6c-943e-de9c72b21a23 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.495696 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 779/1580] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/projects => generated 405 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.495696 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17188c1c-3d75-4d6c-943e-de9c72b21a23 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.496560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 802/1581] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.498768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac686-1ab4-4f28-be18-477f849b61f6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.568752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17188c1c-3d75-4d6c-943e-de9c72b21a23 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.571711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735ac686-1ab4-4f28-be18-477f849b61f6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.575402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4494-7050-4cba-82e0-9e2581d75b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.576282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4494-7050-4cba-82e0-9e2581d75b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.577187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4494-7050-4cba-82e0-9e2581d75b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.577452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2d826-0a35-4de4-b9f5-53854cdaa6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.577611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d4494-7050-4cba-82e0-9e2581d75b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.578317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2d826-0a35-4de4-b9f5-53854cdaa6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.578429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d4494-7050-4cba-82e0-9e2581d75b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.578605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2d826-0a35-4de4-b9f5-53854cdaa6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.578882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2d826-0a35-4de4-b9f5-53854cdaa6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.579649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2d826-0a35-4de4-b9f5-53854cdaa6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.580655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d4494-7050-4cba-82e0-9e2581d75b2d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.581249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2d826-0a35-4de4-b9f5-53854cdaa6e1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.592880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 803/1582] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:23.593804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2d826-0a35-4de4-b9f5-53854cdaa6e1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.605221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2d826-0a35-4de4-b9f5-53854cdaa6e1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.611444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fb0b4-4f7a-4914-930a-2b8e49641500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.612322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb0b4-4f7a-4914-930a-2b8e49641500 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.612609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb0b4-4f7a-4914-930a-2b8e49641500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.612893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fb0b4-4f7a-4914-930a-2b8e49641500 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.613621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fb0b4-4f7a-4914-930a-2b8e49641500 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.615591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fb0b4-4f7a-4914-930a-2b8e49641500 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.617982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 780/1583] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.619047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4494-7050-4cba-82e0-9e2581d75b2d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.638646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 804/1584] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.640351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da68e-cd41-45d0-b983-5c132ab30859 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.640976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da68e-cd41-45d0-b983-5c132ab30859 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.641505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091da68e-cd41-45d0-b983-5c132ab30859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.659689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:23.665689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-091da68e-cd41-45d0-b983-5c132ab30859 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:23.667039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-091da68e-cd41-45d0-b983-5c132ab30859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:23.691978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d4494-7050-4cba-82e0-9e2581d75b2d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.697307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c266d-a976-4fde-8806-692110c80658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.697540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:23.697660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c266d-a976-4fde-8806-692110c80658 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.698141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c266d-a976-4fde-8806-692110c80658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.698563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c266d-a976-4fde-8806-692110c80658 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.699417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c266d-a976-4fde-8806-692110c80658 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.701743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c266d-a976-4fde-8806-692110c80658 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.723798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 781/1585] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/users => generated 296 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.724616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c266d-a976-4fde-8806-692110c80658 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.734781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c266d-a976-4fde-8806-692110c80658 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.736393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 805/1586] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:23.737217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da68e-cd41-45d0-b983-5c132ab30859 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.739556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007a5df-52ce-4396-96d2-6d01b9c26af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.740402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a5df-52ce-4396-96d2-6d01b9c26af8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.740765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a5df-52ce-4396-96d2-6d01b9c26af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.741107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007a5df-52ce-4396-96d2-6d01b9c26af8 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.741900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007a5df-52ce-4396-96d2-6d01b9c26af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.743882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007a5df-52ce-4396-96d2-6d01b9c26af8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.747146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091da68e-cd41-45d0-b983-5c132ab30859 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.752799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677472b-c8dc-4e1d-8ed8-7254f88997b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.753574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677472b-c8dc-4e1d-8ed8-7254f88997b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.753926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677472b-c8dc-4e1d-8ed8-7254f88997b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.754204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677472b-c8dc-4e1d-8ed8-7254f88997b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.755192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677472b-c8dc-4e1d-8ed8-7254f88997b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.757285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677472b-c8dc-4e1d-8ed8-7254f88997b7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.767385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 782/1587] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/users => generated 303 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.768647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007a5df-52ce-4396-96d2-6d01b9c26af8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.779684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007a5df-52ce-4396-96d2-6d01b9c26af8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.781138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 806/1588] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.781904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677472b-c8dc-4e1d-8ed8-7254f88997b7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.785815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d81e1c-da04-48b8-a6e4-e722a8929c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.786780 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d81e1c-da04-48b8-a6e4-e722a8929c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.787394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d81e1c-da04-48b8-a6e4-e722a8929c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.787854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d81e1c-da04-48b8-a6e4-e722a8929c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.788599 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d81e1c-da04-48b8-a6e4-e722a8929c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.790363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d81e1c-da04-48b8-a6e4-e722a8929c7f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.793346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677472b-c8dc-4e1d-8ed8-7254f88997b7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.798937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36fa9-1cb7-4e67-bce7-612a575021e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.799660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36fa9-1cb7-4e67-bce7-612a575021e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.799914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36fa9-1cb7-4e67-bce7-612a575021e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.800280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b36fa9-1cb7-4e67-bce7-612a575021e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.801026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b36fa9-1cb7-4e67-bce7-612a575021e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.802935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b36fa9-1cb7-4e67-bce7-612a575021e1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.807485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 783/1589] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:23.808423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d81e1c-da04-48b8-a6e4-e722a8929c7f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.820609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d81e1c-da04-48b8-a6e4-e722a8929c7f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.825974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c6299-1966-4fa6-bdc6-83e74ae2259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.826856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6299-1966-4fa6-bdc6-83e74ae2259b admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.827305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6299-1966-4fa6-bdc6-83e74ae2259b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.827586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c6299-1966-4fa6-bdc6-83e74ae2259b admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.828354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c6299-1966-4fa6-bdc6-83e74ae2259b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.832538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 807/1590] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:23 2022] POST /identity/v3/users => generated 289 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:23.832700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c6299-1966-4fa6-bdc6-83e74ae2259b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.832807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36fa9-1cb7-4e67-bce7-612a575021e1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.842906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b36fa9-1cb7-4e67-bce7-612a575021e1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.844654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 784/1591] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:23.845654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c6299-1966-4fa6-bdc6-83e74ae2259b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.849682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88058363-0a27-46b8-94d0-b25737e29b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.850594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058363-0a27-46b8-94d0-b25737e29b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.851051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058363-0a27-46b8-94d0-b25737e29b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.851652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88058363-0a27-46b8-94d0-b25737e29b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.852415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88058363-0a27-46b8-94d0-b25737e29b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.854683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88058363-0a27-46b8-94d0-b25737e29b37 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.869120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 808/1592] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:23.869120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88058363-0a27-46b8-94d0-b25737e29b37 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.877280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88058363-0a27-46b8-94d0-b25737e29b37 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.882968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81486d61-0391-44b9-bd3b-50d4ac8404fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.883682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81486d61-0391-44b9-bd3b-50d4ac8404fc admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.884104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81486d61-0391-44b9-bd3b-50d4ac8404fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.884402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81486d61-0391-44b9-bd3b-50d4ac8404fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.885192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81486d61-0391-44b9-bd3b-50d4ac8404fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.886952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81486d61-0391-44b9-bd3b-50d4ac8404fc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.902307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 809/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:23.902307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81486d61-0391-44b9-bd3b-50d4ac8404fc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.911690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81486d61-0391-44b9-bd3b-50d4ac8404fc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.917198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e8d65-e47f-43ff-80d7-4fc8d65d24a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.918057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8d65-e47f-43ff-80d7-4fc8d65d24a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.918344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8d65-e47f-43ff-80d7-4fc8d65d24a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.918966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8d65-e47f-43ff-80d7-4fc8d65d24a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.919898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e8d65-e47f-43ff-80d7-4fc8d65d24a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.921784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e8d65-e47f-43ff-80d7-4fc8d65d24a8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.930005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c6299-1966-4fa6-bdc6-83e74ae2259b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.934998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 810/1594] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:23.935902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e8d65-e47f-43ff-80d7-4fc8d65d24a8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:23.939056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd5b6-3332-440e-a0b2-77fae437cf96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.940633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd5b6-3332-440e-a0b2-77fae437cf96 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.941049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd5b6-3332-440e-a0b2-77fae437cf96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.941471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fd5b6-3332-440e-a0b2-77fae437cf96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.949943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e8d65-e47f-43ff-80d7-4fc8d65d24a8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:23.953975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fd5b6-3332-440e-a0b2-77fae437cf96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.955747 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fd5b6-3332-440e-a0b2-77fae437cf96 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.956188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:23.957365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:23.957696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:23.957983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] PATH_INFO: `/v3/projects/c5b5f1f324094c4eafa7c7a2ffe8297d/users/22f0d790c7f3423ea7ea25a81054ccb2/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:23.978236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5b5f1f324094c4eafa7c7a2ffe8297d, user_id=22f0d790c7f3423ea7ea25a81054ccb2, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:23.979335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:41:23.979335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: warnings.warn(msg) Jul 12 13:41:23.979335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: Jul 12 13:41:23.981369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:23.987978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 785/1595] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:23.989133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd5b6-3332-440e-a0b2-77fae437cf96 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.000956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fd5b6-3332-440e-a0b2-77fae437cf96 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.006558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 811/1596] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:23 2022] PUT /identity/v3/projects/c5b5f1f324094c4eafa7c7a2ffe8297d/users/22f0d790c7f3423ea7ea25a81054ccb2/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:24.018640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.089571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60ebd22-222a-4e46-9dfd-06f3049bdc33 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.094994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae9adf-26bb-4963-8fba-f9c10f8bde2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.095777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae9adf-26bb-4963-8fba-f9c10f8bde2a admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.096131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae9adf-26bb-4963-8fba-f9c10f8bde2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.096765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae9adf-26bb-4963-8fba-f9c10f8bde2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.097749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae9adf-26bb-4963-8fba-f9c10f8bde2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.099405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae9adf-26bb-4963-8fba-f9c10f8bde2a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.108233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdde26a-fc0c-4f7c-ab35-6b720340d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.109509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde26a-fc0c-4f7c-ab35-6b720340d32c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.109798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde26a-fc0c-4f7c-ab35-6b720340d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.110079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdde26a-fc0c-4f7c-ab35-6b720340d32c admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.110883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 812/1597] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:24.111953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae9adf-26bb-4963-8fba-f9c10f8bde2a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.112193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdde26a-fc0c-4f7c-ab35-6b720340d32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.116978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdde26a-fc0c-4f7c-ab35-6b720340d32c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.122798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae9adf-26bb-4963-8fba-f9c10f8bde2a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.128750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935a58-477f-4a3b-a226-c8fb259ab15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.129562 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935a58-477f-4a3b-a226-c8fb259ab15c admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.129911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935a58-477f-4a3b-a226-c8fb259ab15c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.130321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935a58-477f-4a3b-a226-c8fb259ab15c admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.131173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d935a58-477f-4a3b-a226-c8fb259ab15c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.133209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d935a58-477f-4a3b-a226-c8fb259ab15c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.140768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 786/1598] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:24.145319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 813/1599] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:24.146509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935a58-477f-4a3b-a226-c8fb259ab15c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.146839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdde26a-fc0c-4f7c-ab35-6b720340d32c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.158469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935a58-477f-4a3b-a226-c8fb259ab15c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.163861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1dde4-9657-4c4a-9d0d-07b073af2a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.164723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1dde4-9657-4c4a-9d0d-07b073af2a1f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.165071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1dde4-9657-4c4a-9d0d-07b073af2a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.165452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1dde4-9657-4c4a-9d0d-07b073af2a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.167661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1dde4-9657-4c4a-9d0d-07b073af2a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.168875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdde26a-fc0c-4f7c-ab35-6b720340d32c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.169852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1dde4-9657-4c4a-9d0d-07b073af2a1f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.178020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f293bb-513d-4271-8416-c9f7cfce7492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.178725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f293bb-513d-4271-8416-c9f7cfce7492 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.179019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f293bb-513d-4271-8416-c9f7cfce7492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.179296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f293bb-513d-4271-8416-c9f7cfce7492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.180080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f293bb-513d-4271-8416-c9f7cfce7492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.181708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f293bb-513d-4271-8416-c9f7cfce7492 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.188017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 814/1600] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:24.188017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16399-55bf-4c74-8286-a2c3aa9e7e57 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.188017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16399-55bf-4c74-8286-a2c3aa9e7e57 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.188017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a16399-55bf-4c74-8286-a2c3aa9e7e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.196472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:24.210600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 787/1601] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:24.213915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f293bb-513d-4271-8416-c9f7cfce7492 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.224349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:24.232458 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-53a16399-55bf-4c74-8286-a2c3aa9e7e57 None None] MFA Rules not processed for user `22f0d790c7f3423ea7ea25a81054ccb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:24.234216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-53a16399-55bf-4c74-8286-a2c3aa9e7e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:24.237982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f293bb-513d-4271-8416-c9f7cfce7492 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.251688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70026bf-9e2b-41c5-bfa9-8bf22794c744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.252895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70026bf-9e2b-41c5-bfa9-8bf22794c744 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.253365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70026bf-9e2b-41c5-bfa9-8bf22794c744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.253812 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70026bf-9e2b-41c5-bfa9-8bf22794c744 admin admin] PATH_INFO: `/v3/projects/18e3245698f94c95974b73b9f336b799/users/1ae7fa6721f14ecabd7d8eebc10928cc/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.285532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70026bf-9e2b-41c5-bfa9-8bf22794c744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e3245698f94c95974b73b9f336b799, user_id=1ae7fa6721f14ecabd7d8eebc10928cc, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.288242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70026bf-9e2b-41c5-bfa9-8bf22794c744 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.311759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 788/1602] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:24 2022] PUT /identity/v3/projects/18e3245698f94c95974b73b9f336b799/users/1ae7fa6721f14ecabd7d8eebc10928cc/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:24.312687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70026bf-9e2b-41c5-bfa9-8bf22794c744 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.335094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 815/1603] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:24.336123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a16399-55bf-4c74-8286-a2c3aa9e7e57 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.368096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a16399-55bf-4c74-8286-a2c3aa9e7e57 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.440640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86a27-2b56-4e71-9619-fd5a6e216849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.441567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86a27-2b56-4e71-9619-fd5a6e216849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.441848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86a27-2b56-4e71-9619-fd5a6e216849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.442367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a86a27-2b56-4e71-9619-fd5a6e216849 admin admin] PATH_INFO: `/v3/projects/b554e8d81aba49928903563d4db30e63/users/2eb98f1b1bf440ba8c3d10894f5518be/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.447041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70026bf-9e2b-41c5-bfa9-8bf22794c744 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.465097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629214ce-e874-4829-924d-35b649896a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.465850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629214ce-e874-4829-924d-35b649896a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.466277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629214ce-e874-4829-924d-35b649896a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.466563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629214ce-e874-4829-924d-35b649896a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.467504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629214ce-e874-4829-924d-35b649896a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.468095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a86a27-2b56-4e71-9619-fd5a6e216849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b554e8d81aba49928903563d4db30e63, user_id=2eb98f1b1bf440ba8c3d10894f5518be, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.469405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629214ce-e874-4829-924d-35b649896a1a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.471470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a86a27-2b56-4e71-9619-fd5a6e216849 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.495867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 816/1604] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:24 2022] PUT /identity/v3/projects/b554e8d81aba49928903563d4db30e63/users/2eb98f1b1bf440ba8c3d10894f5518be/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:24.503917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86a27-2b56-4e71-9619-fd5a6e216849 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.504378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 789/1605] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:24.506763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629214ce-e874-4829-924d-35b649896a1a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.535129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629214ce-e874-4829-924d-35b649896a1a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.630432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a86a27-2b56-4e71-9619-fd5a6e216849 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.639679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5538-62d2-414d-9c2a-270706cf9c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.641604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5538-62d2-414d-9c2a-270706cf9c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.643927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5538-62d2-414d-9c2a-270706cf9c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.644754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5538-62d2-414d-9c2a-270706cf9c19 admin admin] PATH_INFO: `/v3/projects/684fc455699445a6b24c277518cc9bf4/users/636181e787714128869124b40ab14c6b/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.675127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5538-62d2-414d-9c2a-270706cf9c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=684fc455699445a6b24c277518cc9bf4, user_id=636181e787714128869124b40ab14c6b, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.680219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5538-62d2-414d-9c2a-270706cf9c19 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.686664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d26d7-19e4-440e-ae46-4244d3b27780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.687757 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d26d7-19e4-440e-ae46-4244d3b27780 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.688041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d26d7-19e4-440e-ae46-4244d3b27780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.688379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21d26d7-19e4-440e-ae46-4244d3b27780 admin admin] PATH_INFO: `/v3/projects/32f4b35bd2864765ab61455a971d9d0f/users/131c0d87c0a242cf93c93142ae4e4052/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.716525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 817/1606] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:24 2022] PUT /identity/v3/projects/684fc455699445a6b24c277518cc9bf4/users/636181e787714128869124b40ab14c6b/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:24.718279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06948ead-4793-4828-8f5d-d8e0ce92580d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.718755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06948ead-4793-4828-8f5d-d8e0ce92580d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.719169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06948ead-4793-4828-8f5d-d8e0ce92580d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.724812 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d26d7-19e4-440e-ae46-4244d3b27780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f4b35bd2864765ab61455a971d9d0f, user_id=131c0d87c0a242cf93c93142ae4e4052, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.727516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21d26d7-19e4-440e-ae46-4244d3b27780 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.749923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:24.768500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 790/1607] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:24 2022] PUT /identity/v3/projects/32f4b35bd2864765ab61455a971d9d0f/users/131c0d87c0a242cf93c93142ae4e4052/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:24.768500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d26d7-19e4-440e-ae46-4244d3b27780 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:24.770333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-06948ead-4793-4828-8f5d-d8e0ce92580d None None] MFA Rules not processed for user `1ae7fa6721f14ecabd7d8eebc10928cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:24.772439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-06948ead-4793-4828-8f5d-d8e0ce92580d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:24.880429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:24.890725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21d26d7-19e4-440e-ae46-4244d3b27780 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:24.896846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 818/1608] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:24.899340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5c44a-1b5c-4279-bcdb-68c245f11f15 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.900153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5c44a-1b5c-4279-bcdb-68c245f11f15 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.900497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5c44a-1b5c-4279-bcdb-68c245f11f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.905415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b30d9a-709d-4ef0-abe2-338f964c38a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:24.906849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30d9a-709d-4ef0-abe2-338f964c38a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:24.907344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30d9a-709d-4ef0-abe2-338f964c38a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:24.907718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b30d9a-709d-4ef0-abe2-338f964c38a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:24.908489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b30d9a-709d-4ef0-abe2-338f964c38a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:24.915177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b30d9a-709d-4ef0-abe2-338f964c38a9 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:24.948419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c8b5c44a-1b5c-4279-bcdb-68c245f11f15 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:24.958765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c8b5c44a-1b5c-4279-bcdb-68c245f11f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:24.987735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 819/1609] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:24.988710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5c44a-1b5c-4279-bcdb-68c245f11f15 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:25.004891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 791/1610] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:24 2022] POST /identity/v3/projects => generated 367 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:25.005800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5c44a-1b5c-4279-bcdb-68c245f11f15 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:25.006628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b398-3691-4f0c-8c1f-ecc136e42daa None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.006939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b398-3691-4f0c-8c1f-ecc136e42daa None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.008134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b398-3691-4f0c-8c1f-ecc136e42daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.045186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d577b398-3691-4f0c-8c1f-ecc136e42daa None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:25.047076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d577b398-3691-4f0c-8c1f-ecc136e42daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:25.127165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8453bc88-a5eb-47fa-ab26-f737f86b1893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:25.128301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bc88-a5eb-47fa-ab26-f737f86b1893 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.129200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bc88-a5eb-47fa-ab26-f737f86b1893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.130195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8453bc88-a5eb-47fa-ab26-f737f86b1893 admin admin] PATH_INFO: `/v3/projects/523620ee15ef4a88b365aa51d7766847/users/6bb38e1511e44eca8ebaf7524e4cef80/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.162844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bc88-a5eb-47fa-ab26-f737f86b1893 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523620ee15ef4a88b365aa51d7766847, user_id=6bb38e1511e44eca8ebaf7524e4cef80, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:25.167051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8453bc88-a5eb-47fa-ab26-f737f86b1893 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:25.185919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 792/1611] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:25.187470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff41d-2617-4a7e-9b82-d55f6b20f1ce None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.187900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff41d-2617-4a7e-9b82-d55f6b20f1ce None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.188268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ff41d-2617-4a7e-9b82-d55f6b20f1ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.204054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 820/1612] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:24 2022] PUT /identity/v3/projects/523620ee15ef4a88b365aa51d7766847/users/6bb38e1511e44eca8ebaf7524e4cef80/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:25.205735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213b46-dc4a-4fec-a7e0-887e008b8e07 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.206122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213b46-dc4a-4fec-a7e0-887e008b8e07 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.206493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c213b46-dc4a-4fec-a7e0-887e008b8e07 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.209995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 821/1613] 10.222.0.64 () {54 vars in 961 bytes} [Tue Jul 12 13:41:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:41:25.214077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c213b46-dc4a-4fec-a7e0-887e008b8e07 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:25.220827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2c213b46-dc4a-4fec-a7e0-887e008b8e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:25.256150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-fc0ff41d-2617-4a7e-9b82-d55f6b20f1ce None None] MFA Rules not processed for user `131c0d87c0a242cf93c93142ae4e4052`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:25.260657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fc0ff41d-2617-4a7e-9b82-d55f6b20f1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:25.336560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c213b46-dc4a-4fec-a7e0-887e008b8e07 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:25.342529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b3f4f-77c0-43ac-b84e-a7a481ed8fb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:25.344045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b3f4f-77c0-43ac-b84e-a7a481ed8fb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.344423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b3f4f-77c0-43ac-b84e-a7a481ed8fb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.344806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547b3f4f-77c0-43ac-b84e-a7a481ed8fb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.480432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 793/1614] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:25 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:25.480432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ff41d-2617-4a7e-9b82-d55f6b20f1ce None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:25.482947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:25.525391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b3f4f-77c0-43ac-b84e-a7a481ed8fb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:25.526967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547b3f4f-77c0-43ac-b84e-a7a481ed8fb1 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:25.547964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 822/1615] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:25.550372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b3f4f-77c0-43ac-b84e-a7a481ed8fb1 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:25.572111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547b3f4f-77c0-43ac-b84e-a7a481ed8fb1 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:25.581630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ff41d-2617-4a7e-9b82-d55f6b20f1ce None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:25.582419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac2b51-28bd-4176-b6e8-a73c04b3cb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:25.583188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac2b51-28bd-4176-b6e8-a73c04b3cb03 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.583561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac2b51-28bd-4176-b6e8-a73c04b3cb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.583952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac2b51-28bd-4176-b6e8-a73c04b3cb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.597361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8adc5eb-08e5-47a0-ab9f-40e32d7002fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:25.598661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adc5eb-08e5-47a0-ab9f-40e32d7002fb admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.599057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adc5eb-08e5-47a0-ab9f-40e32d7002fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.599423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adc5eb-08e5-47a0-ab9f-40e32d7002fb admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.600379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adc5eb-08e5-47a0-ab9f-40e32d7002fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:25.603524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac2b51-28bd-4176-b6e8-a73c04b3cb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:25.603968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8adc5eb-08e5-47a0-ab9f-40e32d7002fb admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:25.606877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac2b51-28bd-4176-b6e8-a73c04b3cb03 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:25.628754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 823/1616] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:25.630406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88278835-711a-456c-908d-78be8e87de5e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.630786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88278835-711a-456c-908d-78be8e87de5e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.631155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88278835-711a-456c-908d-78be8e87de5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.639463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:25.649631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 794/1617] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:25 2022] POST /identity/v3/users => generated 290 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:25.651487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6b01-4d6a-4614-8bd1-f33b1824c3e0 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.652034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6b01-4d6a-4614-8bd1-f33b1824c3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.652432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa6b01-4d6a-4614-8bd1-f33b1824c3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.677277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-88278835-711a-456c-908d-78be8e87de5e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:25.682891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-88278835-711a-456c-908d-78be8e87de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:25.700909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 824/1618] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:25.701990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88278835-711a-456c-908d-78be8e87de5e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:25.702818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-68fa6b01-4d6a-4614-8bd1-f33b1824c3e0 None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:25.704164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-68fa6b01-4d6a-4614-8bd1-f33b1824c3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:25.725307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88278835-711a-456c-908d-78be8e87de5e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:25.739890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538b56f-48de-498a-88b0-ee9ccb8d538e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:25.740880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b56f-48de-498a-88b0-ee9ccb8d538e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.741601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b56f-48de-498a-88b0-ee9ccb8d538e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.742043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538b56f-48de-498a-88b0-ee9ccb8d538e admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.742765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538b56f-48de-498a-88b0-ee9ccb8d538e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:25.744830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538b56f-48de-498a-88b0-ee9ccb8d538e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:25.804244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 825/1619] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:25 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:25.804429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538b56f-48de-498a-88b0-ee9ccb8d538e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:25.813032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 795/1620] 10.222.0.64 () {58 vars in 1058 bytes} [Tue Jul 12 13:41:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:25.814668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa6b01-4d6a-4614-8bd1-f33b1824c3e0 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:25.826880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa6b01-4d6a-4614-8bd1-f33b1824c3e0 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:25.915362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463be4e-7dc1-4217-aa87-3a8436ddb750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:25.916280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463be4e-7dc1-4217-aa87-3a8436ddb750 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.916854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463be4e-7dc1-4217-aa87-3a8436ddb750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.917268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1463be4e-7dc1-4217-aa87-3a8436ddb750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.954935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538b56f-48de-498a-88b0-ee9ccb8d538e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:25.961602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86623321-cead-4cff-9aa4-6385b657ed48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:25.962523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623321-cead-4cff-9aa4-6385b657ed48 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:25.962957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623321-cead-4cff-9aa4-6385b657ed48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:25.963454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86623321-cead-4cff-9aa4-6385b657ed48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:25.964383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86623321-cead-4cff-9aa4-6385b657ed48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:25.966510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86623321-cead-4cff-9aa4-6385b657ed48 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:25.985435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 826/1621] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:25.986633 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86623321-cead-4cff-9aa4-6385b657ed48 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.003997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86623321-cead-4cff-9aa4-6385b657ed48 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.011047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b862f-22c4-47e7-8cd8-f990ee90bed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.012289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b862f-22c4-47e7-8cd8-f990ee90bed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.012579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b862f-22c4-47e7-8cd8-f990ee90bed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.012933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b862f-22c4-47e7-8cd8-f990ee90bed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.013665 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b862f-22c4-47e7-8cd8-f990ee90bed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.016343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b862f-22c4-47e7-8cd8-f990ee90bed9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.036700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463be4e-7dc1-4217-aa87-3a8436ddb750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.039272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1463be4e-7dc1-4217-aa87-3a8436ddb750 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.054269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 827/1622] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:25 2022] POST /identity/v3/users => generated 309 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:26.055230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b862f-22c4-47e7-8cd8-f990ee90bed9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.055646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 796/1623] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:26.056898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463be4e-7dc1-4217-aa87-3a8436ddb750 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.075172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1463be4e-7dc1-4217-aa87-3a8436ddb750 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.081738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497bc9f-d5c5-4746-884f-90ace1c1d978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.083078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497bc9f-d5c5-4746-884f-90ace1c1d978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.083544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497bc9f-d5c5-4746-884f-90ace1c1d978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.084008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497bc9f-d5c5-4746-884f-90ace1c1d978 admin admin] PATH_INFO: `/v3/projects/feafa37bfcb94a689d6a6dcf40288b3b/users/445867c649c14f38abc1bb20bddcf4ab/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.114958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497bc9f-d5c5-4746-884f-90ace1c1d978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feafa37bfcb94a689d6a6dcf40288b3b, user_id=445867c649c14f38abc1bb20bddcf4ab, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.118740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497bc9f-d5c5-4746-884f-90ace1c1d978 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.146544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 797/1624] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:26 2022] PUT /identity/v3/projects/feafa37bfcb94a689d6a6dcf40288b3b/users/445867c649c14f38abc1bb20bddcf4ab/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:26.148056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497bc9f-d5c5-4746-884f-90ace1c1d978 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.156862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:26.180035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:26.218475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b862f-22c4-47e7-8cd8-f990ee90bed9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.263288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497bc9f-d5c5-4746-884f-90ace1c1d978 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.277047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc7d-feee-445e-b7fb-95beebab4fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.278520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc7d-feee-445e-b7fb-95beebab4fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.278801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc7d-feee-445e-b7fb-95beebab4fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.279082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73cc7d-feee-445e-b7fb-95beebab4fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.283069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73cc7d-feee-445e-b7fb-95beebab4fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.286765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73cc7d-feee-445e-b7fb-95beebab4fa0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.306073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 798/1625] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:26.307258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc7d-feee-445e-b7fb-95beebab4fa0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.323367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73cc7d-feee-445e-b7fb-95beebab4fa0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.330330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6f92-e69c-4d86-bbb2-140cbd0379f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.332522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6f92-e69c-4d86-bbb2-140cbd0379f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.332997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6f92-e69c-4d86-bbb2-140cbd0379f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.334083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf6f92-e69c-4d86-bbb2-140cbd0379f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.335258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf6f92-e69c-4d86-bbb2-140cbd0379f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.339921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf6f92-e69c-4d86-bbb2-140cbd0379f6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.357224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 799/1626] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:26.357767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd7deb-ad41-4c51-b8f2-ea17757aa55e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.358465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd7deb-ad41-4c51-b8f2-ea17757aa55e service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.358750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd7deb-ad41-4c51-b8f2-ea17757aa55e service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.358894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6f92-e69c-4d86-bbb2-140cbd0379f6 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.359014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd7deb-ad41-4c51-b8f2-ea17757aa55e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.375561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf6f92-e69c-4d86-bbb2-140cbd0379f6 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.389293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0a20-4743-4eb0-ac35-8d027e86b7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.390378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0a20-4743-4eb0-ac35-8d027e86b7b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.390664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0a20-4743-4eb0-ac35-8d027e86b7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.390947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab0a20-4743-4eb0-ac35-8d027e86b7b9 admin admin] PATH_INFO: `/v3/projects/7727dbadf2124d22bf4da33e1fac6caa/users/13304996c46349fea4a50eabb8a4546d/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.424586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0a20-4743-4eb0-ac35-8d027e86b7b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7727dbadf2124d22bf4da33e1fac6caa, user_id=13304996c46349fea4a50eabb8a4546d, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.428804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab0a20-4743-4eb0-ac35-8d027e86b7b9 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.461584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 800/1627] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:26 2022] PUT /identity/v3/projects/7727dbadf2124d22bf4da33e1fac6caa/users/13304996c46349fea4a50eabb8a4546d/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:26.462631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0a20-4743-4eb0-ac35-8d027e86b7b9 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.462893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd7deb-ad41-4c51-b8f2-ea17757aa55e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.465384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd7deb-ad41-4c51-b8f2-ea17757aa55e service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.479695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 828/1628] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:26.480886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd7deb-ad41-4c51-b8f2-ea17757aa55e service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.524343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd7deb-ad41-4c51-b8f2-ea17757aa55e service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.635670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab0a20-4743-4eb0-ac35-8d027e86b7b9 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.649861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3332304-0399-4bd0-a4cf-b542c4fb9ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.652100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3332304-0399-4bd0-a4cf-b542c4fb9ba3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.652754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3332304-0399-4bd0-a4cf-b542c4fb9ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.653158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3332304-0399-4bd0-a4cf-b542c4fb9ba3 admin admin] PATH_INFO: `/v3/projects/feafa37bfcb94a689d6a6dcf40288b3b/users/445867c649c14f38abc1bb20bddcf4ab/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.655421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3332304-0399-4bd0-a4cf-b542c4fb9ba3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feafa37bfcb94a689d6a6dcf40288b3b, user_id=445867c649c14f38abc1bb20bddcf4ab, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.659171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3332304-0399-4bd0-a4cf-b542c4fb9ba3 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.682751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3e6c4-f481-4d53-b1c4-a13bd98ab138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.683455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3e6c4-f481-4d53-b1c4-a13bd98ab138 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.683766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3e6c4-f481-4d53-b1c4-a13bd98ab138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.684045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e3e6c4-f481-4d53-b1c4-a13bd98ab138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.684788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3e6c4-f481-4d53-b1c4-a13bd98ab138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.686618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e3e6c4-f481-4d53-b1c4-a13bd98ab138 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.687001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 801/1629] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:26 2022] PUT /identity/v3/projects/feafa37bfcb94a689d6a6dcf40288b3b/users/445867c649c14f38abc1bb20bddcf4ab/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:26.701757 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0ede-48bd-46b2-8f69-53d1d5a28aac None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.702077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0ede-48bd-46b2-8f69-53d1d5a28aac None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.702323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c0ede-48bd-46b2-8f69-53d1d5a28aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.710370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 829/1630] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:26.715515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3e6c4-f481-4d53-b1c4-a13bd98ab138 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.749075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-fd3c0ede-48bd-46b2-8f69-53d1d5a28aac None None] MFA Rules not processed for user `445867c649c14f38abc1bb20bddcf4ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:26.751154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fd3c0ede-48bd-46b2-8f69-53d1d5a28aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:26.754365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e3e6c4-f481-4d53-b1c4-a13bd98ab138 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:26.807897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:26.822891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:26.856972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608a7b2a-a8d6-46e5-866f-71cc92baa809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:26.857922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7b2a-a8d6-46e5-866f-71cc92baa809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.858203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7b2a-a8d6-46e5-866f-71cc92baa809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.858830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a7b2a-a8d6-46e5-866f-71cc92baa809 admin admin] PATH_INFO: `/v3/projects/7727dbadf2124d22bf4da33e1fac6caa/users/13304996c46349fea4a50eabb8a4546d/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.861301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a7b2a-a8d6-46e5-866f-71cc92baa809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7727dbadf2124d22bf4da33e1fac6caa, user_id=13304996c46349fea4a50eabb8a4546d, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:26.863697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608a7b2a-a8d6-46e5-866f-71cc92baa809 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:26.865942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 802/1631] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:26.883843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 830/1632] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:26 2022] PUT /identity/v3/projects/7727dbadf2124d22bf4da33e1fac6caa/users/13304996c46349fea4a50eabb8a4546d/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:41:26.884109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0ede-48bd-46b2-8f69-53d1d5a28aac None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:26.888543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91396c-112c-4203-a0ec-48cb3a33504b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:26.888543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91396c-112c-4203-a0ec-48cb3a33504b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:26.888543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91396c-112c-4203-a0ec-48cb3a33504b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:26.957068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1e91396c-112c-4203-a0ec-48cb3a33504b None None] MFA Rules not processed for user `13304996c46349fea4a50eabb8a4546d`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:26.958383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1e91396c-112c-4203-a0ec-48cb3a33504b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:27.039805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c0ede-48bd-46b2-8f69-53d1d5a28aac None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:27.150406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3ae85-d0dc-4f98-ab62-6c26753467e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:27.151466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3ae85-d0dc-4f98-ab62-6c26753467e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:27.151809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 831/1633] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:26 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:27.152243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3ae85-d0dc-4f98-ab62-6c26753467e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:27.152673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3ae85-d0dc-4f98-ab62-6c26753467e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:27.163589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91396c-112c-4203-a0ec-48cb3a33504b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:27.176886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91396c-112c-4203-a0ec-48cb3a33504b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:27.190705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1750b3-a12a-4bde-982c-c5e8a4d5e5a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:27.191401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1750b3-a12a-4bde-982c-c5e8a4d5e5a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:27.192693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1750b3-a12a-4bde-982c-c5e8a4d5e5a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:27.192990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1750b3-a12a-4bde-982c-c5e8a4d5e5a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:27.248687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1750b3-a12a-4bde-982c-c5e8a4d5e5a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:27.250170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1750b3-a12a-4bde-982c-c5e8a4d5e5a0 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:27.281050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 832/1634] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:41:27.304787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3ae85-d0dc-4f98-ab62-6c26753467e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:27.307527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3ae85-d0dc-4f98-ab62-6c26753467e4 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:27.339893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 803/1635] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:27.593809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305eac-0bda-4c91-88db-06b4b666f38d None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:27.594029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305eac-0bda-4c91-88db-06b4b666f38d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:27.594244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea305eac-0bda-4c91-88db-06b4b666f38d None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:27.596213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 833/1636] 10.222.0.64 () {54 vars in 961 bytes} [Tue Jul 12 13:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:41:27.612708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6508c-5ae6-40ba-97c3-b7449cf93040 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:27.613447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6508c-5ae6-40ba-97c3-b7449cf93040 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:27.614050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6508c-5ae6-40ba-97c3-b7449cf93040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:27.620750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305eac-0bda-4c91-88db-06b4b666f38d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:27.671805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f4a6508c-5ae6-40ba-97c3-b7449cf93040 None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:27.673946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f4a6508c-5ae6-40ba-97c3-b7449cf93040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:27.750358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:27.786111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea305eac-0bda-4c91-88db-06b4b666f38d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:27.803120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:27.804576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:27.807493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:27.807493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] PATH_INFO: `/v3/users/131c0d87c0a242cf93c93142ae4e4052` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:27.810503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131c0d87c0a242cf93c93142ae4e4052)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:27.815963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: WARNING py.warnings [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:41:27.815963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: warnings.warn(msg) Jul 12 13:41:27.815963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: Jul 12 13:41:27.819022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 804/1637] 10.222.0.64 () {58 vars in 1058 bytes} [Tue Jul 12 13:41:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:27.819334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:27.826458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2623-37c0-4cd6-b476-71c2d1ed3ad4 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:27.826839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2623-37c0-4cd6-b476-71c2d1ed3ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:27.827209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffc2623-37c0-4cd6-b476-71c2d1ed3ad4 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:27.830054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 805/1638] 10.222.0.64 () {54 vars in 912 bytes} [Tue Jul 12 13:41:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:41:27.837553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190fa82-f62d-4848-a878-b32e89028fdd None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:27.837553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190fa82-f62d-4848-a878-b32e89028fdd None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:27.837735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190fa82-f62d-4848-a878-b32e89028fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:27.888299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5190fa82-f62d-4848-a878-b32e89028fdd None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:27.889489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5190fa82-f62d-4848-a878-b32e89028fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:27.914079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 806/1639] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:41:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:27.935088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190fa82-f62d-4848-a878-b32e89028fdd None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:27.965830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:27.976976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190fa82-f62d-4848-a878-b32e89028fdd None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:27.986603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131c0d87c0a242cf93c93142ae4e4052'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:27.988027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd79c4a-0a48-4442-a6da-022fa1d3c1f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:27.988762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79c4a-0a48-4442-a6da-022fa1d3c1f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:27.989164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79c4a-0a48-4442-a6da-022fa1d3c1f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:27.989461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd79c4a-0a48-4442-a6da-022fa1d3c1f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:27.989641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131c0d87c0a242cf93c93142ae4e4052'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:28.004756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79c4a-0a48-4442-a6da-022fa1d3c1f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:28.006967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd79c4a-0a48-4442-a6da-022fa1d3c1f6 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:28.011159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131c0d87c0a242cf93c93142ae4e4052'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:28.025184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 807/1640] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:41:28.033776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131c0d87c0a242cf93c93142ae4e4052'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:28.034547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131c0d87c0a242cf93c93142ae4e4052'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:28.091731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6109-cc80-44a1-83fd-d1d8d3d9bd48 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:28.092280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6109-cc80-44a1-83fd-d1d8d3d9bd48 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:28.092280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c6109-cc80-44a1-83fd-d1d8d3d9bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:28.093822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 834/1641] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:27 2022] DELETE /identity/v3/users/131c0d87c0a242cf93c93142ae4e4052 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:28.180514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-257c6109-cc80-44a1-83fd-d1d8d3d9bd48 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:28.192092 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-257c6109-cc80-44a1-83fd-d1d8d3d9bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:28.403586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 808/1642] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:28.427276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:28.429123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:28.447665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ea4ab-f472-42c9-8d09-3beba9831810 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:28.448345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ea4ab-f472-42c9-8d09-3beba9831810 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:28.448946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ea4ab-f472-42c9-8d09-3beba9831810 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:28.451095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 809/1643] 10.222.0.64 () {54 vars in 912 bytes} [Tue Jul 12 13:41:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:41:28.459678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a531e-cf92-4813-b4ef-0df5cec66742 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:28.460217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a531e-cf92-4813-b4ef-0df5cec66742 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:28.460709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a531e-cf92-4813-b4ef-0df5cec66742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:28.529098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-535a531e-cf92-4813-b4ef-0df5cec66742 None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:28.536805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-535a531e-cf92-4813-b4ef-0df5cec66742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:28.615732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e3c95-e50b-4fef-8abe-0231a8038a15 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:28.626249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:28.628723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:28.628816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:28.629045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:28.668528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:28.670101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:28.695164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 835/1644] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:28.752647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 810/1645] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:41:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 12 13:41:28.768797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:28.770246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:28.893014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975799f0-ef94-473d-8d22-68ab449ad966 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:28.901766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475db1a-6877-4a13-859d-897134380e7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:28.902513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475db1a-6877-4a13-859d-897134380e7a service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:28.902794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475db1a-6877-4a13-859d-897134380e7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:28.903066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475db1a-6877-4a13-859d-897134380e7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:28.930837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475db1a-6877-4a13-859d-897134380e7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:28.932438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475db1a-6877-4a13-859d-897134380e7a service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:28.984583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 836/1646] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:29.207717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a531e-cf92-4813-b4ef-0df5cec66742 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:29.209568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-535a531e-cf92-4813-b4ef-0df5cec66742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:29.241074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a531e-cf92-4813-b4ef-0df5cec66742 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:29.248430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:29.250044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:29.250334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:29.250608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] PATH_INFO: `/v3/users/1ae7fa6721f14ecabd7d8eebc10928cc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:29.252280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ae7fa6721f14ecabd7d8eebc10928cc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:29.255677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:29.387059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ae7fa6721f14ecabd7d8eebc10928cc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:29.392581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:29.418200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ae7fa6721f14ecabd7d8eebc10928cc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:29.419803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ae7fa6721f14ecabd7d8eebc10928cc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:29.442746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ae7fa6721f14ecabd7d8eebc10928cc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:29.488641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ae7fa6721f14ecabd7d8eebc10928cc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:29.517495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 811/1647] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:29 2022] DELETE /identity/v3/users/1ae7fa6721f14ecabd7d8eebc10928cc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:29.522655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9e72-360f-4e3a-867c-e1ec9f2cb6ca None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:29.522940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9e72-360f-4e3a-867c-e1ec9f2cb6ca None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:29.523537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef9e72-360f-4e3a-867c-e1ec9f2cb6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:29.557388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7bef9e72-360f-4e3a-867c-e1ec9f2cb6ca None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:29.558628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7bef9e72-360f-4e3a-867c-e1ec9f2cb6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:29.667206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 837/1648] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:29.789532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:29.792653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:29.987423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a55f3d9-be92-4f9b-8185-c2a787b89de9 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:29.996299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b7ef6-a827-40b4-a00e-6a532d1e7109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:29.996983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7ef6-a827-40b4-a00e-6a532d1e7109 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:29.997268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7ef6-a827-40b4-a00e-6a532d1e7109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:29.997545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b7ef6-a827-40b4-a00e-6a532d1e7109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:30.022005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b7ef6-a827-40b4-a00e-6a532d1e7109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:30.026407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b7ef6-a827-40b4-a00e-6a532d1e7109 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:30.051380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 812/1649] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:30.150010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef9e72-360f-4e3a-867c-e1ec9f2cb6ca None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:30.154155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7bef9e72-360f-4e3a-867c-e1ec9f2cb6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:30.165195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:30.171815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef9e72-360f-4e3a-867c-e1ec9f2cb6ca None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:30.178527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:30.180282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:30.181191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:30.181693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] PATH_INFO: `/v3/users/22f0d790c7f3423ea7ea25a81054ccb2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:30.184331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22f0d790c7f3423ea7ea25a81054ccb2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:30.186891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:30.273074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22f0d790c7f3423ea7ea25a81054ccb2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.274441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22f0d790c7f3423ea7ea25a81054ccb2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.296416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22f0d790c7f3423ea7ea25a81054ccb2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.309284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22f0d790c7f3423ea7ea25a81054ccb2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.310606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22f0d790c7f3423ea7ea25a81054ccb2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.340077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 838/1650] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:30 2022] DELETE /identity/v3/users/22f0d790c7f3423ea7ea25a81054ccb2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:30.348916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773b64f-aefb-47ef-a9a5-7e07b1306765 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:30.351012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773b64f-aefb-47ef-a9a5-7e07b1306765 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:30.352474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773b64f-aefb-47ef-a9a5-7e07b1306765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:30.387485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0773b64f-aefb-47ef-a9a5-7e07b1306765 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:30.388926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0773b64f-aefb-47ef-a9a5-7e07b1306765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:30.475109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:30.476650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:30.622966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 813/1651] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:30.670161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773b64f-aefb-47ef-a9a5-7e07b1306765 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:30.673142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0773b64f-aefb-47ef-a9a5-7e07b1306765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:30.683759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca3973-d4f7-46fe-b3b0-48e23f3f50f7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:30.690661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:30.691845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:30.693370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:30.693674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] PATH_INFO: `/v3/projects/32f4b35bd2864765ab61455a971d9d0f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:30.697897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f4b35bd2864765ab61455a971d9d0f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:30.703385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:30.837151 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f4b35bd2864765ab61455a971d9d0f', 'request_id': 'req-0e91451d-fa62-4ddf-a93b-ffaa39385348'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.870839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773b64f-aefb-47ef-a9a5-7e07b1306765 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:30.887175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f4b35bd2864765ab61455a971d9d0f', 'request_id': 'req-0e91451d-fa62-4ddf-a93b-ffaa39385348'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.921987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f4b35bd2864765ab61455a971d9d0f', 'request_id': 'req-0e91451d-fa62-4ddf-a93b-ffaa39385348'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.984699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] The token cache is being invalidate because project 32f4b35bd2864765ab61455a971d9d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:30.985265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.992171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:30.997970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 839/1652] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:30 2022] DELETE /identity/v3/projects/32f4b35bd2864765ab61455a971d9d0f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:31.001887 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:31.004876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:31.007557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:31.037586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:31.076412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:31.077461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:31.077890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:31.078309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:31.085168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:31.202164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91451d-fa62-4ddf-a93b-ffaa39385348 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:31.221507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:31.222213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:31.223131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:31.223639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:31.224165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:31.224645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] PATH_INFO: `/v3/users/13304996c46349fea4a50eabb8a4546d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:31.227802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13304996c46349fea4a50eabb8a4546d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:31.230055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:31.236724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 814/1653] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:31.325684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13304996c46349fea4a50eabb8a4546d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:31.326541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13304996c46349fea4a50eabb8a4546d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:31.339862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13304996c46349fea4a50eabb8a4546d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:31.349087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13304996c46349fea4a50eabb8a4546d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:31.350626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7a66cbd8-7bb5-44ff-b85d-daa9255d75f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13304996c46349fea4a50eabb8a4546d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:31.370815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 840/1654] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:31 2022] DELETE /identity/v3/users/13304996c46349fea4a50eabb8a4546d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:41:31.962559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:31.964184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:31.989823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89641d08-80f3-4ab5-86c2-fc2dd83df099 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:32.102124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:32.104909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:32.105440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:32.106089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] PATH_INFO: `/v3/projects/18e3245698f94c95974b73b9f336b799` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:32.108936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e3245698f94c95974b73b9f336b799)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:32.111931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: WARNING py.warnings [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 13:41:32.111931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: warnings.warn(msg) Jul 12 13:41:32.111931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: Jul 12 13:41:32.114902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:32.272562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e3245698f94c95974b73b9f336b799', 'request_id': 'req-77872e19-f034-47b2-80e5-5fe70f528163'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:32.289209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e3245698f94c95974b73b9f336b799', 'request_id': 'req-77872e19-f034-47b2-80e5-5fe70f528163'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:32.297526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e3245698f94c95974b73b9f336b799', 'request_id': 'req-77872e19-f034-47b2-80e5-5fe70f528163'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:32.320773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] The token cache is being invalidate because project 18e3245698f94c95974b73b9f336b799 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:32.320773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:32.321622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-77872e19-f034-47b2-80e5-5fe70f528163 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:32.328089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 815/1655] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:31 2022] DELETE /identity/v3/projects/18e3245698f94c95974b73b9f336b799 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:32.330122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8f56-6589-4c01-80f9-654a0117b3ac None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:32.330618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8f56-6589-4c01-80f9-654a0117b3ac None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:32.330698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8f56-6589-4c01-80f9-654a0117b3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:32.353710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a5ba8f56-6589-4c01-80f9-654a0117b3ac None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:32.355193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a5ba8f56-6589-4c01-80f9-654a0117b3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:32.446952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb046ec-ae54-4a85-a6e7-949a44beab7b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:32.447240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb046ec-ae54-4a85-a6e7-949a44beab7b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:32.448582 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb046ec-ae54-4a85-a6e7-949a44beab7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:32.457591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 841/1656] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:32.469379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:32.477314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3cb046ec-ae54-4a85-a6e7-949a44beab7b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:32.480671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3cb046ec-ae54-4a85-a6e7-949a44beab7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:32.503273 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba8f56-6589-4c01-80f9-654a0117b3ac None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:32.515074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 816/1657] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:32.519200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba8f56-6589-4c01-80f9-654a0117b3ac None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:32.526426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:32.528179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:32.528651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:32.529163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:32.530214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:32.530747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:32.533850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:32.558454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb046ec-ae54-4a85-a6e7-949a44beab7b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:32.567345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 842/1658] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:32.575143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb046ec-ae54-4a85-a6e7-949a44beab7b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:32.582004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:32.583096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:32.583471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:32.583948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:32.584833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:32.588274 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:32.633811 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 817/1659] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:32 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:32.635286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:32.647546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e3bb2-08ca-4cbb-a2b5-561999f8a527 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:32.659817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:32.749628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ecf0d-bd32-4e1a-b393-2a6a9c0ae3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:32.752969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ecf0d-bd32-4e1a-b393-2a6a9c0ae3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:32.753313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ecf0d-bd32-4e1a-b393-2a6a9c0ae3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:32.756799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ecf0d-bd32-4e1a-b393-2a6a9c0ae3dc admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:32.756799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ecf0d-bd32-4e1a-b393-2a6a9c0ae3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:32.759621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ecf0d-bd32-4e1a-b393-2a6a9c0ae3dc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:32.760746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:32.763455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:32.790507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 843/1660] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:32 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:41:32.793466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ecf0d-bd32-4e1a-b393-2a6a9c0ae3dc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:32.803069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5148c0-9fc4-46af-8314-f07813c76be1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:32.809637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ecf0d-bd32-4e1a-b393-2a6a9c0ae3dc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:32.815920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:32.816828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:32.817224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:32.817397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] PATH_INFO: `/v3/projects/c5b5f1f324094c4eafa7c7a2ffe8297d` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:32.818112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:32.820014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:32.820135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5b5f1f324094c4eafa7c7a2ffe8297d)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:32.820999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:32.821649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:32.822153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:32.824150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:32.827188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:32.859115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 844/1661] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:32.860719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:32.868841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:32.908616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19208f89-0046-4645-9427-790a7fae8d7a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:32.948394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5b5f1f324094c4eafa7c7a2ffe8297d', 'request_id': 'req-e51ec5d6-8d68-46be-b5c8-085eddf5994a'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:32.972285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5b5f1f324094c4eafa7c7a2ffe8297d', 'request_id': 'req-e51ec5d6-8d68-46be-b5c8-085eddf5994a'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:32.984397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5b5f1f324094c4eafa7c7a2ffe8297d', 'request_id': 'req-e51ec5d6-8d68-46be-b5c8-085eddf5994a'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.023278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] The token cache is being invalidate because project c5b5f1f324094c4eafa7c7a2ffe8297d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:33.023579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.024866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.030075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 818/1662] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:32 2022] DELETE /identity/v3/projects/c5b5f1f324094c4eafa7c7a2ffe8297d => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:33.031308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:33.048859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:33.093627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:33.097634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.097940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.098225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] PATH_INFO: `/v3/projects/7727dbadf2124d22bf4da33e1fac6caa` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.100109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7727dbadf2124d22bf4da33e1fac6caa)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:33.102096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:33.184931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51ec5d6-8d68-46be-b5c8-085eddf5994a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:33.210433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7727dbadf2124d22bf4da33e1fac6caa', 'request_id': 'req-c47c2125-80f6-471f-9b3c-07ad4cce4a98'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.219546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7727dbadf2124d22bf4da33e1fac6caa', 'request_id': 'req-c47c2125-80f6-471f-9b3c-07ad4cce4a98'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.235415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7727dbadf2124d22bf4da33e1fac6caa', 'request_id': 'req-c47c2125-80f6-471f-9b3c-07ad4cce4a98'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.259868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] The token cache is being invalidate because project 7727dbadf2124d22bf4da33e1fac6caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:33.260175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.268034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.277283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 845/1663] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:32 2022] DELETE /identity/v3/projects/7727dbadf2124d22bf4da33e1fac6caa => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:33.277283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:33.277283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:33.336785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:33.369638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2229c976-e562-4d59-9820-bf76d3ba90d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:33.373390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c976-e562-4d59-9820-bf76d3ba90d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.373762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c976-e562-4d59-9820-bf76d3ba90d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.374657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2229c976-e562-4d59-9820-bf76d3ba90d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.376066 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229c976-e562-4d59-9820-bf76d3ba90d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:33.380064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2229c976-e562-4d59-9820-bf76d3ba90d5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:33.405941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 819/1664] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:33 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:33.408917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869208b-2b03-44e8-9352-f102ea051a5b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.409189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869208b-2b03-44e8-9352-f102ea051a5b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.409470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869208b-2b03-44e8-9352-f102ea051a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.430152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:33.452944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c2125-80f6-471f-9b3c-07ad4cce4a98 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:33.455293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3869208b-2b03-44e8-9352-f102ea051a5b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:33.456469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3869208b-2b03-44e8-9352-f102ea051a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:33.464227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:33.466516 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.466885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.467172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] PATH_INFO: `/v3/users/445867c649c14f38abc1bb20bddcf4ab` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.468838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=445867c649c14f38abc1bb20bddcf4ab)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:33.481375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 820/1665] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:33.481648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:33.484499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869208b-2b03-44e8-9352-f102ea051a5b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:33.489152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3869208b-2b03-44e8-9352-f102ea051a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:33.516599 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869208b-2b03-44e8-9352-f102ea051a5b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:33.531348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309809bf-70c4-4167-a1f7-3e7f2eb522b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:33.532374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309809bf-70c4-4167-a1f7-3e7f2eb522b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.532658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309809bf-70c4-4167-a1f7-3e7f2eb522b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.532982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309809bf-70c4-4167-a1f7-3e7f2eb522b5 admin admin] PATH_INFO: `/v3/projects/3dec950729694a85acbdd2614c24479c/users/7e6f14a6cbd7488eabc7a37df344642c/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.565190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '445867c649c14f38abc1bb20bddcf4ab'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.565910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '445867c649c14f38abc1bb20bddcf4ab'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.570028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309809bf-70c4-4167-a1f7-3e7f2eb522b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dec950729694a85acbdd2614c24479c, user_id=7e6f14a6cbd7488eabc7a37df344642c, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:33.572683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309809bf-70c4-4167-a1f7-3e7f2eb522b5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:33.575296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '445867c649c14f38abc1bb20bddcf4ab'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.586112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '445867c649c14f38abc1bb20bddcf4ab'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.587469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4b5ea29-58d7-4d58-8bea-1c925c800ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '445867c649c14f38abc1bb20bddcf4ab'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:33.598855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 821/1666] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:33 2022] PUT /identity/v3/projects/3dec950729694a85acbdd2614c24479c/users/7e6f14a6cbd7488eabc7a37df344642c/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:33.600086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3b8b-74f8-494b-b690-9eeebe76a2b1 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.600377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3b8b-74f8-494b-b690-9eeebe76a2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.600654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f3b8b-74f8-494b-b690-9eeebe76a2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.611460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 846/1667] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:33 2022] DELETE /identity/v3/users/445867c649c14f38abc1bb20bddcf4ab => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:33.613329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b620-aec1-4e3a-afc0-f90cc8faac71 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.613654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b620-aec1-4e3a-afc0-f90cc8faac71 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.613921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235b620-aec1-4e3a-afc0-f90cc8faac71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.639644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-900f3b8b-74f8-494b-b690-9eeebe76a2b1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:33.641029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-900f3b8b-74f8-494b-b690-9eeebe76a2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:33.671453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2235b620-aec1-4e3a-afc0-f90cc8faac71 None None] MFA Rules not processed for user `7e6f14a6cbd7488eabc7a37df344642c`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:33.673002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2235b620-aec1-4e3a-afc0-f90cc8faac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:33.729227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 822/1668] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:33.731096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f3b8b-74f8-494b-b690-9eeebe76a2b1 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:33.744134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f3b8b-74f8-494b-b690-9eeebe76a2b1 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:33.752979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:33.754799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.756793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.756959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 847/1669] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:33.758050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.760483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:33.761641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:33.763138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b620-aec1-4e3a-afc0-f90cc8faac71 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:33.764920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:33.765996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2235b620-aec1-4e3a-afc0-f90cc8faac71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:33.784268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 823/1670] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:33.785547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:33.798287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06a546a-caf8-4e8c-9b5a-007efaea2929 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:33.799915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235b620-aec1-4e3a-afc0-f90cc8faac71 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:33.806437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3bb27-3453-4851-9cca-0624d5fc3065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:33.807814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3bb27-3453-4851-9cca-0624d5fc3065 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.808296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3bb27-3453-4851-9cca-0624d5fc3065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.808813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b3bb27-3453-4851-9cca-0624d5fc3065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.808923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c943c23-6e13-468f-8ad0-870ea6a29e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:33.810846 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3bb27-3453-4851-9cca-0624d5fc3065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:33.811256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c943c23-6e13-468f-8ad0-870ea6a29e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:33.811654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c943c23-6e13-468f-8ad0-870ea6a29e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:33.812008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c943c23-6e13-468f-8ad0-870ea6a29e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:33.813056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c943c23-6e13-468f-8ad0-870ea6a29e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:33.813992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b3bb27-3453-4851-9cca-0624d5fc3065 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:33.815647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c943c23-6e13-468f-8ad0-870ea6a29e13 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:33.860933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 848/1671] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:33 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:33.862599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c943c23-6e13-468f-8ad0-870ea6a29e13 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:33.865519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 824/1672] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:33 2022] POST /identity/v3/projects => generated 405 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:33.866441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3bb27-3453-4851-9cca-0624d5fc3065 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:33.881685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:33.982183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c943c23-6e13-468f-8ad0-870ea6a29e13 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.024623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b3bb27-3453-4851-9cca-0624d5fc3065 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.038215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fb487-4012-407d-8d04-5b5ac5e853a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.039291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fb487-4012-407d-8d04-5b5ac5e853a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.039827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fb487-4012-407d-8d04-5b5ac5e853a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.040413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83fb487-4012-407d-8d04-5b5ac5e853a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.041552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fb487-4012-407d-8d04-5b5ac5e853a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.047282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83fb487-4012-407d-8d04-5b5ac5e853a0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.055377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869e17a-b9ac-4f77-aacc-f756b994f49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.057489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869e17a-b9ac-4f77-aacc-f756b994f49c admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.058337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869e17a-b9ac-4f77-aacc-f756b994f49c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.058671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869e17a-b9ac-4f77-aacc-f756b994f49c admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.059774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869e17a-b9ac-4f77-aacc-f756b994f49c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.063103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869e17a-b9ac-4f77-aacc-f756b994f49c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.089592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 825/1673] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:33 2022] POST /identity/v3/users => generated 303 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:34.098651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 849/1674] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:33 2022] POST /identity/v3/users => generated 293 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:34.099417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fb487-4012-407d-8d04-5b5ac5e853a0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:34.099622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869e17a-b9ac-4f77-aacc-f756b994f49c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:34.114245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869e17a-b9ac-4f77-aacc-f756b994f49c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.115356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83fb487-4012-407d-8d04-5b5ac5e853a0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.125222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd83e7-7be7-4b7c-a0d2-7e5147bfaf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.125479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c20f18-2588-4b3b-94c0-44c395adbb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.126165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd83e7-7be7-4b7c-a0d2-7e5147bfaf6f admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.126553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd83e7-7be7-4b7c-a0d2-7e5147bfaf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.127579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c20f18-2588-4b3b-94c0-44c395adbb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.127989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cd83e7-7be7-4b7c-a0d2-7e5147bfaf6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.128342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c20f18-2588-4b3b-94c0-44c395adbb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.128787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c20f18-2588-4b3b-94c0-44c395adbb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.129269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd83e7-7be7-4b7c-a0d2-7e5147bfaf6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.130107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c20f18-2588-4b3b-94c0-44c395adbb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.132051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cd83e7-7be7-4b7c-a0d2-7e5147bfaf6f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.132385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c20f18-2588-4b3b-94c0-44c395adbb2f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.148604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 850/1675] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:34.154716 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c20f18-2588-4b3b-94c0-44c395adbb2f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:34.158597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 826/1676] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:34.162481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd83e7-7be7-4b7c-a0d2-7e5147bfaf6f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:34.168424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c20f18-2588-4b3b-94c0-44c395adbb2f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.176306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed593f-dd6d-4a63-8dcd-4e332d682e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.177549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed593f-dd6d-4a63-8dcd-4e332d682e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.177977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed593f-dd6d-4a63-8dcd-4e332d682e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.178393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed593f-dd6d-4a63-8dcd-4e332d682e02 admin admin] PATH_INFO: `/v3/projects/8131d3651de2480692fe702f11c0a544/users/2cdb01f5f277413f8f22c9dda9edfea9/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.180449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cd83e7-7be7-4b7c-a0d2-7e5147bfaf6f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.196062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033d2f9-48aa-4913-bc9c-f6932b859437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.196972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d2f9-48aa-4913-bc9c-f6932b859437 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.197480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d2f9-48aa-4913-bc9c-f6932b859437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.197849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b033d2f9-48aa-4913-bc9c-f6932b859437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.198708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033d2f9-48aa-4913-bc9c-f6932b859437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.200717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b033d2f9-48aa-4913-bc9c-f6932b859437 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.200921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed593f-dd6d-4a63-8dcd-4e332d682e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8131d3651de2480692fe702f11c0a544, user_id=2cdb01f5f277413f8f22c9dda9edfea9, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.204469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed593f-dd6d-4a63-8dcd-4e332d682e02 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.224845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 827/1677] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:41:34.227707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033d2f9-48aa-4913-bc9c-f6932b859437 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:34.240092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 851/1678] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:34 2022] PUT /identity/v3/projects/8131d3651de2480692fe702f11c0a544/users/2cdb01f5f277413f8f22c9dda9edfea9/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:34.240979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed593f-dd6d-4a63-8dcd-4e332d682e02 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:34.244298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b033d2f9-48aa-4913-bc9c-f6932b859437 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.249538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:34.360722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014e6c-37d7-424c-b189-27e7165c0916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.362079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014e6c-37d7-424c-b189-27e7165c0916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.362501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014e6c-37d7-424c-b189-27e7165c0916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.363456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014e6c-37d7-424c-b189-27e7165c0916 admin admin] PATH_INFO: `/v3/projects/46f93d3a905e48059e99cc72c355dd6d/users/1f3d43d7a2e0486396b86e9104977b03/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.396129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0014e6c-37d7-424c-b189-27e7165c0916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f93d3a905e48059e99cc72c355dd6d, user_id=1f3d43d7a2e0486396b86e9104977b03, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.401099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0014e6c-37d7-424c-b189-27e7165c0916 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.409918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed593f-dd6d-4a63-8dcd-4e332d682e02 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.419837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7a57-a801-41e2-a45c-176810497092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.423290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7a57-a801-41e2-a45c-176810497092 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.425945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7a57-a801-41e2-a45c-176810497092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.427113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa7a57-a801-41e2-a45c-176810497092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.431187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7a57-a801-41e2-a45c-176810497092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.433415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 828/1679] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:34 2022] PUT /identity/v3/projects/46f93d3a905e48059e99cc72c355dd6d/users/1f3d43d7a2e0486396b86e9104977b03/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:34.435277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa7a57-a801-41e2-a45c-176810497092 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.438651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735954f-e5b3-49a4-bb91-f14e0c0c471c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.439767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735954f-e5b3-49a4-bb91-f14e0c0c471c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.440262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735954f-e5b3-49a4-bb91-f14e0c0c471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.460666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 852/1680] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:34.465454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-8735954f-e5b3-49a4-bb91-f14e0c0c471c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:34.467455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7a57-a801-41e2-a45c-176810497092 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:34.468034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8735954f-e5b3-49a4-bb91-f14e0c0c471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:34.490064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa7a57-a801-41e2-a45c-176810497092 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.503500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:34.578130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 829/1681] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:34.604167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735954f-e5b3-49a4-bb91-f14e0c0c471c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:34.606401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8735954f-e5b3-49a4-bb91-f14e0c0c471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:34.620966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd6190-566e-4644-8205-261d61a52543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.621907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd6190-566e-4644-8205-261d61a52543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.622195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd6190-566e-4644-8205-261d61a52543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.622471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd6190-566e-4644-8205-261d61a52543 admin admin] PATH_INFO: `/v3/projects/8131d3651de2480692fe702f11c0a544/users/2cdb01f5f277413f8f22c9dda9edfea9/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.630696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd6190-566e-4644-8205-261d61a52543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8131d3651de2480692fe702f11c0a544, user_id=2cdb01f5f277413f8f22c9dda9edfea9, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:34.636454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd6190-566e-4644-8205-261d61a52543 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:34.663648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 853/1682] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:34 2022] PUT /identity/v3/projects/8131d3651de2480692fe702f11c0a544/users/2cdb01f5f277413f8f22c9dda9edfea9/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:34.676712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62677-cd8c-453e-830d-ab6f5afbab66 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.677006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62677-cd8c-453e-830d-ab6f5afbab66 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.677289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f62677-cd8c-453e-830d-ab6f5afbab66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.742250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-84f62677-cd8c-453e-830d-ab6f5afbab66 None None] MFA Rules not processed for user `2cdb01f5f277413f8f22c9dda9edfea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:34.744932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-84f62677-cd8c-453e-830d-ab6f5afbab66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:34.745873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735954f-e5b3-49a4-bb91-f14e0c0c471c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:34.881883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:34.900601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:34.901310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.901590 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.901867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:34.954702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 854/1683] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:34.954702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf2501-b8da-4625-a4c1-97385c353477 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:34.954702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf2501-b8da-4625-a4c1-97385c353477 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:34.954702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bf2501-b8da-4625-a4c1-97385c353477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:35.020394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c1bf2501-b8da-4625-a4c1-97385c353477 None None] MFA Rules not processed for user `0c10f3ffc56c4743b65e55a8936bc0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:35.022660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c1bf2501-b8da-4625-a4c1-97385c353477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:35.053680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:35.057465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:35.087065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 830/1684] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:41:35.089679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:35.092952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:35.220828 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 855/1685] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:35.235700 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf2501-b8da-4625-a4c1-97385c353477 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:35.237421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c1bf2501-b8da-4625-a4c1-97385c353477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:35.269568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0737d39-35e9-4d9e-b34e-7d758a4a7ee2 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:35.277883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:35.286919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba42a0-b7cf-4942-8042-cd549228a3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:35.287730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba42a0-b7cf-4942-8042-cd549228a3dc service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:35.288069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba42a0-b7cf-4942-8042-cd549228a3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:35.288349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba42a0-b7cf-4942-8042-cd549228a3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:35.341304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba42a0-b7cf-4942-8042-cd549228a3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:35.343161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba42a0-b7cf-4942-8042-cd549228a3dc service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:35.369889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 831/1686] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:35.500392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095c71-b717-4e2e-b2ad-611dedb5e9c5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:35.501035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095c71-b717-4e2e-b2ad-611dedb5e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:35.502017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54095c71-b717-4e2e-b2ad-611dedb5e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:35.505183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bf2501-b8da-4625-a4c1-97385c353477 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:35.535204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaacf0-58b2-40ef-8a81-7d09ef591622 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:35.535933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaacf0-58b2-40ef-8a81-7d09ef591622 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:35.536208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaacf0-58b2-40ef-8a81-7d09ef591622 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:35.536481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcaacf0-58b2-40ef-8a81-7d09ef591622 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:35.547283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-54095c71-b717-4e2e-b2ad-611dedb5e9c5 None None] MFA Rules not processed for user `0b6134cfb9cf44a9bc86f6c639283b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:35.587923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-54095c71-b717-4e2e-b2ad-611dedb5e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:35.593646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaacf0-58b2-40ef-8a81-7d09ef591622 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:35.596871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcaacf0-58b2-40ef-8a81-7d09ef591622 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:35.641704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 856/1687] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:41:35.666509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaacf0-58b2-40ef-8a81-7d09ef591622 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:35.683389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcaacf0-58b2-40ef-8a81-7d09ef591622 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:35.692010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76f025-e6c3-4aba-8464-96bac87f45f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:35.692738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f025-e6c3-4aba-8464-96bac87f45f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:35.692974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f025-e6c3-4aba-8464-96bac87f45f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:35.693256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76f025-e6c3-4aba-8464-96bac87f45f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:35.774599 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 832/1688] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:35.811706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095c71-b717-4e2e-b2ad-611dedb5e9c5 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:35.813888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-54095c71-b717-4e2e-b2ad-611dedb5e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:35.860808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54095c71-b717-4e2e-b2ad-611dedb5e9c5 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:35.876173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:35.876855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:35.877150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:35.877433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:35.917717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:35.924753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:35.935019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f025-e6c3-4aba-8464-96bac87f45f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:35.942888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76f025-e6c3-4aba-8464-96bac87f45f2 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:35.953670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 833/1689] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:35.974181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 857/1690] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:41:36.105330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:36.106950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:36.137617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7375baf5-8a44-4b6d-861d-960cb3bbe1cd service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:36.157417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:36.158376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:36.158663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:36.158940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] PATH_INFO: `/v3/projects/feafa37bfcb94a689d6a6dcf40288b3b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:36.160265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feafa37bfcb94a689d6a6dcf40288b3b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:36.162413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:36.214412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:36.374280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feafa37bfcb94a689d6a6dcf40288b3b', 'request_id': 'req-87068de2-b977-43ea-a00f-9f5b0f282075'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:36.412473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feafa37bfcb94a689d6a6dcf40288b3b', 'request_id': 'req-87068de2-b977-43ea-a00f-9f5b0f282075'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:36.425278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feafa37bfcb94a689d6a6dcf40288b3b', 'request_id': 'req-87068de2-b977-43ea-a00f-9f5b0f282075'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:36.466266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] The token cache is being invalidate because project feafa37bfcb94a689d6a6dcf40288b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:36.466485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:36.467249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-87068de2-b977-43ea-a00f-9f5b0f282075 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:36.469494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 834/1691] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:36 2022] DELETE /identity/v3/projects/feafa37bfcb94a689d6a6dcf40288b3b => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:36.475189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed50f9-8456-4c57-afaa-4e08522f1af2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:36.475581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed50f9-8456-4c57-afaa-4e08522f1af2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:36.476349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed50f9-8456-4c57-afaa-4e08522f1af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:36.545893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b3ed50f9-8456-4c57-afaa-4e08522f1af2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:36.551846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b3ed50f9-8456-4c57-afaa-4e08522f1af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:36.730481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 858/1692] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:36.739456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3c84-95d8-40b3-bcf2-05564bda5b86 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:36.740288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3c84-95d8-40b3-bcf2-05564bda5b86 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:36.740772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee3c84-95d8-40b3-bcf2-05564bda5b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:36.777700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b1ee3c84-95d8-40b3-bcf2-05564bda5b86 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:36.779072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b1ee3c84-95d8-40b3-bcf2-05564bda5b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:36.808927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 835/1693] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:36.810381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed50f9-8456-4c57-afaa-4e08522f1af2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:36.826730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed50f9-8456-4c57-afaa-4e08522f1af2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:36.847426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:36.849545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:36.850745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:36.853080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:36.854118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:36.854918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:36.858884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:36.900404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 859/1694] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:36.901763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee3c84-95d8-40b3-bcf2-05564bda5b86 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:36.922978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee3c84-95d8-40b3-bcf2-05564bda5b86 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:36.938693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06acc5c-e868-4d2f-a065-ff28bf0c7452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:36.939825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06acc5c-e868-4d2f-a065-ff28bf0c7452 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:36.942483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06acc5c-e868-4d2f-a065-ff28bf0c7452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:36.942801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06acc5c-e868-4d2f-a065-ff28bf0c7452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:36.943546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06acc5c-e868-4d2f-a065-ff28bf0c7452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:36.951124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06acc5c-e868-4d2f-a065-ff28bf0c7452 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:37.066241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 836/1695] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:36 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:37.069527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:37.092502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08208f76-8906-4bbb-b5c0-940e7e647b5f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:37.220963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:37.349953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee530f9-8b78-43aa-9dd3-af35d1466f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:37.354546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee530f9-8b78-43aa-9dd3-af35d1466f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:37.354946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee530f9-8b78-43aa-9dd3-af35d1466f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:37.355829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee530f9-8b78-43aa-9dd3-af35d1466f97 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:37.356794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee530f9-8b78-43aa-9dd3-af35d1466f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:37.361593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee530f9-8b78-43aa-9dd3-af35d1466f97 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:37.417875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 860/1696] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:37 2022] POST /identity/v3/users => generated 285 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:37.422641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06acc5c-e868-4d2f-a065-ff28bf0c7452 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:37.441052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06acc5c-e868-4d2f-a065-ff28bf0c7452 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:37.468940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ad763-5d4f-44e8-8bea-eab75941e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:37.469892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad763-5d4f-44e8-8bea-eab75941e118 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:37.470183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad763-5d4f-44e8-8bea-eab75941e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:37.470468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ad763-5d4f-44e8-8bea-eab75941e118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:37.485672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ad763-5d4f-44e8-8bea-eab75941e118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:37.495630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ad763-5d4f-44e8-8bea-eab75941e118 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:37.557031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 837/1697] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:37.561321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee530f9-8b78-43aa-9dd3-af35d1466f97 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:37.578288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee530f9-8b78-43aa-9dd3-af35d1466f97 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:37.595685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b75a1f-15bd-4eb2-b4df-41c56fe21718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:37.598838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b75a1f-15bd-4eb2-b4df-41c56fe21718 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:37.598838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b75a1f-15bd-4eb2-b4df-41c56fe21718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:37.599032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b75a1f-15bd-4eb2-b4df-41c56fe21718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:37.602378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b75a1f-15bd-4eb2-b4df-41c56fe21718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:37.607376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b75a1f-15bd-4eb2-b4df-41c56fe21718 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:37.638124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 861/1698] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:37.643162 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ad763-5d4f-44e8-8bea-eab75941e118 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:37.658609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ad763-5d4f-44e8-8bea-eab75941e118 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:37.680255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4806e-6221-4715-8067-fceb20578177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:37.681575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4806e-6221-4715-8067-fceb20578177 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:37.682033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4806e-6221-4715-8067-fceb20578177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:37.682348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4806e-6221-4715-8067-fceb20578177 admin admin] PATH_INFO: `/v3/projects/22a37b78cbd54d80ac72b0cb24314612/users/b0ea95754ee14311b07b18928026cf51/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:37.733837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4806e-6221-4715-8067-fceb20578177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a37b78cbd54d80ac72b0cb24314612, user_id=b0ea95754ee14311b07b18928026cf51, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:37.741894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4806e-6221-4715-8067-fceb20578177 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:37.784367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 838/1699] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:37 2022] PUT /identity/v3/projects/22a37b78cbd54d80ac72b0cb24314612/users/b0ea95754ee14311b07b18928026cf51/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:37.796074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb61f3c-dfaf-4368-8f03-8988185ab1ed None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:37.796381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb61f3c-dfaf-4368-8f03-8988185ab1ed None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:37.796727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb61f3c-dfaf-4368-8f03-8988185ab1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:37.862791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ffb61f3c-dfaf-4368-8f03-8988185ab1ed None None] MFA Rules not processed for user `b0ea95754ee14311b07b18928026cf51`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:37.866008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ffb61f3c-dfaf-4368-8f03-8988185ab1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:38.099002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 862/1700] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:38.103349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4806e-6221-4715-8067-fceb20578177 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:38.270721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4806e-6221-4715-8067-fceb20578177 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:38.282827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9cd4-9cdc-4bd8-9cc9-e6d18dfbd07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:38.283646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9cd4-9cdc-4bd8-9cc9-e6d18dfbd07e admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:38.283940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9cd4-9cdc-4bd8-9cc9-e6d18dfbd07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:38.284223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9cd4-9cdc-4bd8-9cc9-e6d18dfbd07e admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:38.284949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9cd4-9cdc-4bd8-9cc9-e6d18dfbd07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:38.286913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9cd4-9cdc-4bd8-9cc9-e6d18dfbd07e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:38.352023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 839/1701] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:38 2022] POST /identity/v3/projects => generated 367 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:38.355364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb61f3c-dfaf-4368-8f03-8988185ab1ed None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:38.374586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb61f3c-dfaf-4368-8f03-8988185ab1ed None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:38.569988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b332e-82d8-4744-9c84-489d277906d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:38.573601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b332e-82d8-4744-9c84-489d277906d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:38.574994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b332e-82d8-4744-9c84-489d277906d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:38.577153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97b332e-82d8-4744-9c84-489d277906d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:38.579299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b332e-82d8-4744-9c84-489d277906d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:38.584787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97b332e-82d8-4744-9c84-489d277906d7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:38.628041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 863/1702] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:38 2022] POST /identity/v3/users => generated 290 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:38.631848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9cd4-9cdc-4bd8-9cc9-e6d18dfbd07e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:38.669275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9cd4-9cdc-4bd8-9cc9-e6d18dfbd07e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:38.679320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e6ba-1d63-469c-b3a2-c6febf8c7c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:38.687989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e6ba-1d63-469c-b3a2-c6febf8c7c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:38.689789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e6ba-1d63-469c-b3a2-c6febf8c7c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:38.690312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528e6ba-1d63-469c-b3a2-c6febf8c7c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:38.694251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528e6ba-1d63-469c-b3a2-c6febf8c7c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:38.701655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528e6ba-1d63-469c-b3a2-c6febf8c7c69 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:38.727415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 840/1703] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:38.732199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b332e-82d8-4744-9c84-489d277906d7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:38.747996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97b332e-82d8-4744-9c84-489d277906d7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:38.762780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c34f3-bf6a-417c-8905-46a5cf02655c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:38.763905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c34f3-bf6a-417c-8905-46a5cf02655c admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:38.764203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c34f3-bf6a-417c-8905-46a5cf02655c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:38.764487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c34f3-bf6a-417c-8905-46a5cf02655c admin admin] PATH_INFO: `/v3/projects/480a690191904abc9a571eb1926dc49e/users/0698c6052ff140efbea08e88fa85f2bd/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:38.806474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c34f3-bf6a-417c-8905-46a5cf02655c admin admin] RBAC: Authorizing `identity:create_grant(project_id=480a690191904abc9a571eb1926dc49e, user_id=0698c6052ff140efbea08e88fa85f2bd, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:38.810081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c34f3-bf6a-417c-8905-46a5cf02655c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:38.825718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:38.844138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 864/1704] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:38 2022] PUT /identity/v3/projects/480a690191904abc9a571eb1926dc49e/users/0698c6052ff140efbea08e88fa85f2bd/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:38.846533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e6ba-1d63-469c-b3a2-c6febf8c7c69 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:38.862110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528e6ba-1d63-469c-b3a2-c6febf8c7c69 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:38.877431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:39.100070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd89a8-9127-4d4e-b639-ffe1ef82902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:39.100779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd89a8-9127-4d4e-b639-ffe1ef82902c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:39.101065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd89a8-9127-4d4e-b639-ffe1ef82902c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:39.101344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd89a8-9127-4d4e-b639-ffe1ef82902c admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:39.102096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd89a8-9127-4d4e-b639-ffe1ef82902c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:39.103792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd89a8-9127-4d4e-b639-ffe1ef82902c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:39.143460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 841/1705] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:38 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:39.147403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c34f3-bf6a-417c-8905-46a5cf02655c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:39.165397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c34f3-bf6a-417c-8905-46a5cf02655c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:39.179311 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:39.180427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:39.180825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:39.181191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] PATH_INFO: `/v3/projects/480a690191904abc9a571eb1926dc49e/users/0698c6052ff140efbea08e88fa85f2bd/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:39.186321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=480a690191904abc9a571eb1926dc49e, user_id=0698c6052ff140efbea08e88fa85f2bd, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:39.194830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:39.214382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 865/1706] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:39 2022] PUT /identity/v3/projects/480a690191904abc9a571eb1926dc49e/users/0698c6052ff140efbea08e88fa85f2bd/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:39.224513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4dffb-1574-43ab-bdef-829cabb58450 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:39.224829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4dffb-1574-43ab-bdef-829cabb58450 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:39.225086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4dffb-1574-43ab-bdef-829cabb58450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:39.282832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6cf4dffb-1574-43ab-bdef-829cabb58450 None None] MFA Rules not processed for user `0698c6052ff140efbea08e88fa85f2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:39.289455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6cf4dffb-1574-43ab-bdef-829cabb58450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:39.523996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 842/1707] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:39.544011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:39.546594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:39.664542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f330a06-f26b-48dd-b51b-e56e4845fc0a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:39.669827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:39.671258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:39.672943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:39.673373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:39.706259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:39.707924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:39.754288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 866/1708] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:39 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:39.844312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329803-3404-441b-9f7b-41c694153a02 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:39.844813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329803-3404-441b-9f7b-41c694153a02 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:39.845020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89329803-3404-441b-9f7b-41c694153a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:39.876372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:39.878162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:39.894090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ba376-5dc7-4a08-8dad-c954f422afa5 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:39.909758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:39.910655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:39.911120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:39.911549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:39.924942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-89329803-3404-441b-9f7b-41c694153a02 None None] MFA Rules not processed for user `1f3d43d7a2e0486396b86e9104977b03`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:39.925982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-89329803-3404-441b-9f7b-41c694153a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:40.079058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:40.085351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:40.105916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 867/1709] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:39 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:41:40.186113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 843/1710] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:40.187855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:40.190090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:40.420098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad9114-f3fe-424c-bf2c-b541d35bd183 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:40.436343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e840-21ec-4b1e-8b31-c9cfe9e66b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:40.437831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e840-21ec-4b1e-8b31-c9cfe9e66b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:40.439882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e840-21ec-4b1e-8b31-c9cfe9e66b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:40.442108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50e840-21ec-4b1e-8b31-c9cfe9e66b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:40.444649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50e840-21ec-4b1e-8b31-c9cfe9e66b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:40.454703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50e840-21ec-4b1e-8b31-c9cfe9e66b47 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:40.540891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 868/1711] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:40 2022] POST /identity/v3/projects => generated 405 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:40.545406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89329803-3404-441b-9f7b-41c694153a02 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:40.563334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89329803-3404-441b-9f7b-41c694153a02 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:40.628860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:40.751846 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6d805-8dd6-412b-a189-760c9701aaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:40.752902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6d805-8dd6-412b-a189-760c9701aaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:40.753387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6d805-8dd6-412b-a189-760c9701aaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:40.753843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6d805-8dd6-412b-a189-760c9701aaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:40.754797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6d805-8dd6-412b-a189-760c9701aaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:40.761728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6d805-8dd6-412b-a189-760c9701aaa1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:40.817268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 844/1712] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:40 2022] POST /identity/v3/users => generated 309 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:41:40.819648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e840-21ec-4b1e-8b31-c9cfe9e66b47 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:40.840480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50e840-21ec-4b1e-8b31-c9cfe9e66b47 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:40.863543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c84fb-0588-4a7e-a5ed-909ee1eda11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:40.864785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c84fb-0588-4a7e-a5ed-909ee1eda11d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:40.867804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c84fb-0588-4a7e-a5ed-909ee1eda11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:40.869670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c84fb-0588-4a7e-a5ed-909ee1eda11d admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:40.873896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c84fb-0588-4a7e-a5ed-909ee1eda11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:40.884048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332c84fb-0588-4a7e-a5ed-909ee1eda11d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:40.950355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 869/1713] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:40.954479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6d805-8dd6-412b-a189-760c9701aaa1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:40.976949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6d805-8dd6-412b-a189-760c9701aaa1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:40.993889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3405a4-b53f-4c00-9d95-7d1f279fa6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:40.995937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3405a4-b53f-4c00-9d95-7d1f279fa6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:40.996227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3405a4-b53f-4c00-9d95-7d1f279fa6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:40.996514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3405a4-b53f-4c00-9d95-7d1f279fa6a0 admin admin] PATH_INFO: `/v3/projects/ae46ac1b365a464d9796bdfc8938b986/users/9979c38bfabe433197e31988399bb332/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:41.069085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3405a4-b53f-4c00-9d95-7d1f279fa6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae46ac1b365a464d9796bdfc8938b986, user_id=9979c38bfabe433197e31988399bb332, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:41.078942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3405a4-b53f-4c00-9d95-7d1f279fa6a0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:41.116583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 845/1714] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:40 2022] PUT /identity/v3/projects/ae46ac1b365a464d9796bdfc8938b986/users/9979c38bfabe433197e31988399bb332/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:41.120495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c84fb-0588-4a7e-a5ed-909ee1eda11d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:41.126593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:41.140318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c84fb-0588-4a7e-a5ed-909ee1eda11d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:41.310696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3d6964-9ead-4248-9747-4de17c417287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:41.311427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d6964-9ead-4248-9747-4de17c417287 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:41.311740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d6964-9ead-4248-9747-4de17c417287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:41.312026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3d6964-9ead-4248-9747-4de17c417287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:41.312803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d6964-9ead-4248-9747-4de17c417287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:41.316087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3d6964-9ead-4248-9747-4de17c417287 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:41.347812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 870/1715] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:41.349281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3405a4-b53f-4c00-9d95-7d1f279fa6a0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:41.366866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3405a4-b53f-4c00-9d95-7d1f279fa6a0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:41.381200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:41.381980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:41.382291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:41.382578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] PATH_INFO: `/v3/projects/ae46ac1b365a464d9796bdfc8938b986/users/9979c38bfabe433197e31988399bb332/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:41.388578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae46ac1b365a464d9796bdfc8938b986, user_id=9979c38bfabe433197e31988399bb332, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:41.393852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:41.423242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 846/1716] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:41 2022] PUT /identity/v3/projects/ae46ac1b365a464d9796bdfc8938b986/users/9979c38bfabe433197e31988399bb332/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:41:42.462553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f5e15-1cae-45d7-aef9-2f8b10c27587 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:42.463132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f5e15-1cae-45d7-aef9-2f8b10c27587 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:42.463254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f5e15-1cae-45d7-aef9-2f8b10c27587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:42.538101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-785f5e15-1cae-45d7-aef9-2f8b10c27587 None None] MFA Rules not processed for user `636181e787714128869124b40ab14c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:42.541551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-785f5e15-1cae-45d7-aef9-2f8b10c27587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:42.731562 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 871/1717] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:42.747635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:42.752616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:43.018173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325eda3a-d770-4b29-9e31-53ba7a3f2eef admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:43.031785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e406ac5-138f-4654-85eb-94c25aeb7ebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:43.032484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406ac5-138f-4654-85eb-94c25aeb7ebf service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:43.032771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406ac5-138f-4654-85eb-94c25aeb7ebf service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:43.033047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e406ac5-138f-4654-85eb-94c25aeb7ebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:43.066757 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e406ac5-138f-4654-85eb-94c25aeb7ebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:43.067730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e406ac5-138f-4654-85eb-94c25aeb7ebf service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:43.108014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 847/1718] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:44.007146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554f252-1adb-4a86-8095-295508386def None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:44.007882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554f252-1adb-4a86-8095-295508386def None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:44.007882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c554f252-1adb-4a86-8095-295508386def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:44.071970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c554f252-1adb-4a86-8095-295508386def None None] MFA Rules not processed for user `0c10f3ffc56c4743b65e55a8936bc0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:44.082380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c554f252-1adb-4a86-8095-295508386def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:44.292537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 872/1719] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:45.106530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c3f4-919f-4510-94dc-b6dab77f6f48 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:45.107320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c3f4-919f-4510-94dc-b6dab77f6f48 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:45.107575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb8c3f4-919f-4510-94dc-b6dab77f6f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:45.111142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554f252-1adb-4a86-8095-295508386def None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:45.143540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7bb8c3f4-919f-4510-94dc-b6dab77f6f48 None None] MFA Rules not processed for user `9979c38bfabe433197e31988399bb332`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:45.145370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7bb8c3f4-919f-4510-94dc-b6dab77f6f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:45.187189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:45.211301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:45.281648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c554f252-1adb-4a86-8095-295508386def None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:45.285910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 848/1720] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:45 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:45.294338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:45.295741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:45.296158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:45.296682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] PATH_INFO: `/v3/users/b0ea95754ee14311b07b18928026cf51` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:45.299927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0ea95754ee14311b07b18928026cf51)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:45.312091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:45.422706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0ea95754ee14311b07b18928026cf51'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:45.426977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0ea95754ee14311b07b18928026cf51'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:45.446272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0ea95754ee14311b07b18928026cf51'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:45.456145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0ea95754ee14311b07b18928026cf51'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:45.458022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0ea95754ee14311b07b18928026cf51'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:45.508294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 873/1721] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:45 2022] DELETE /identity/v3/users/b0ea95754ee14311b07b18928026cf51 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:41:45.513501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cb50c-4c58-4e17-9ffe-7fb01a103113 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:45.515297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cb50c-4c58-4e17-9ffe-7fb01a103113 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:45.515776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0cb50c-4c58-4e17-9ffe-7fb01a103113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:45.588371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ca0cb50c-4c58-4e17-9ffe-7fb01a103113 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:45.593978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ca0cb50c-4c58-4e17-9ffe-7fb01a103113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:45.736139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 849/1722] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:45.798555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:45.800219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:45.945089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a94319-f725-41fe-92c8-d16cd071a0e1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:45.956367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd4b5e0-f874-4df8-94b0-3fbb8dc6adf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:45.956706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b5e0-f874-4df8-94b0-3fbb8dc6adf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:45.956901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b5e0-f874-4df8-94b0-3fbb8dc6adf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:45.957176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd4b5e0-f874-4df8-94b0-3fbb8dc6adf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:45.975920 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4b5e0-f874-4df8-94b0-3fbb8dc6adf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:45.977387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd4b5e0-f874-4df8-94b0-3fbb8dc6adf0 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:46.000778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 874/1723] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:46.486124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e22e43-7dff-4a08-b9e9-53a1cea9ae11 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:46.487233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e22e43-7dff-4a08-b9e9-53a1cea9ae11 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:46.487804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e22e43-7dff-4a08-b9e9-53a1cea9ae11 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:46.490020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 850/1724] 10.222.0.64 () {54 vars in 912 bytes} [Tue Jul 12 13:41:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:41:46.500039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6c07-59df-45d9-a9d5-e1c32c1ec652 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:46.500039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6c07-59df-45d9-a9d5-e1c32c1ec652 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:46.500820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6c07-59df-45d9-a9d5-e1c32c1ec652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:46.577102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a6cc6c07-59df-45d9-a9d5-e1c32c1ec652 None None] MFA Rules not processed for user `bcdda7fcb39248c1a5a36ee699d23c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:46.578800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a6cc6c07-59df-45d9-a9d5-e1c32c1ec652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:46.591454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 875/1725] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:41:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:46.661317 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e22e43-7dff-4a08-b9e9-53a1cea9ae11 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:46.664914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f1e22e43-7dff-4a08-b9e9-53a1cea9ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:46.691175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e22e43-7dff-4a08-b9e9-53a1cea9ae11 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:46.695043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e761c0c-3012-4510-9f34-5fe5dd1df93e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:46.695762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761c0c-3012-4510-9f34-5fe5dd1df93e service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:46.696154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761c0c-3012-4510-9f34-5fe5dd1df93e service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:46.696437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e761c0c-3012-4510-9f34-5fe5dd1df93e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:46.706787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e761c0c-3012-4510-9f34-5fe5dd1df93e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:46.708502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e761c0c-3012-4510-9f34-5fe5dd1df93e service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:46.718608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 851/1726] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:46.814820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac4487-3be4-441b-8f1a-a9defdda7bf4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:46.815114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac4487-3be4-441b-8f1a-a9defdda7bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:46.815397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac4487-3be4-441b-8f1a-a9defdda7bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:46.848277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-72ac4487-3be4-441b-8f1a-a9defdda7bf4 None None] MFA Rules not processed for user `0b6134cfb9cf44a9bc86f6c639283b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:46.850222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-72ac4487-3be4-441b-8f1a-a9defdda7bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:46.904079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:46.968193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 876/1727] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:47.651204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898a429-c336-491f-bfd8-438ca5f4fb95 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:47.652750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898a429-c336-491f-bfd8-438ca5f4fb95 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:47.653348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898a429-c336-491f-bfd8-438ca5f4fb95 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:47.656111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 852/1728] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:41:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:41:47.967006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eaa94-6591-4f0a-a2e2-479f806740c7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:47.974170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eaa94-6591-4f0a-a2e2-479f806740c7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:47.974797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eaa94-6591-4f0a-a2e2-479f806740c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:48.038257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-691eaa94-6591-4f0a-a2e2-479f806740c7 None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:48.043896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-691eaa94-6591-4f0a-a2e2-479f806740c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:48.174112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 877/1729] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:41:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:48.206716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38bdd9-f3ee-4105-8c21-fc447f976a34 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:48.207294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38bdd9-f3ee-4105-8c21-fc447f976a34 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:48.207897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38bdd9-f3ee-4105-8c21-fc447f976a34 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:48.209832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 853/1730] 10.222.0.64 () {54 vars in 960 bytes} [Tue Jul 12 13:41:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:41:48.217113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f650af-03c9-42bb-b3f7-4958ed5cbec2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:48.218570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f650af-03c9-42bb-b3f7-4958ed5cbec2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:48.218570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f650af-03c9-42bb-b3f7-4958ed5cbec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:48.267120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-67f650af-03c9-42bb-b3f7-4958ed5cbec2 None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:48.269878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-67f650af-03c9-42bb-b3f7-4958ed5cbec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:48.315309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 878/1731] 10.222.0.64 () {58 vars in 1057 bytes} [Tue Jul 12 13:41:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:48.342147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38bdd9-f3ee-4105-8c21-fc447f976a34 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:48.365352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38bdd9-f3ee-4105-8c21-fc447f976a34 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:48.380908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc41725-9ee3-49bf-a2db-9c14257f16f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:48.381558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc41725-9ee3-49bf-a2db-9c14257f16f8 service placement] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:48.382018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc41725-9ee3-49bf-a2db-9c14257f16f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:48.382438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc41725-9ee3-49bf-a2db-9c14257f16f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:48.409076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc41725-9ee3-49bf-a2db-9c14257f16f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:48.411258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc41725-9ee3-49bf-a2db-9c14257f16f8 service placement] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:48.450365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 854/1732] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:48.647094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f650af-03c9-42bb-b3f7-4958ed5cbec2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:48.673943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f650af-03c9-42bb-b3f7-4958ed5cbec2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:48.679357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2263ca8-bc10-4674-b4c8-2b5dcd1291b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:48.680254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263ca8-bc10-4674-b4c8-2b5dcd1291b0 service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:48.680544 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263ca8-bc10-4674-b4c8-2b5dcd1291b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:48.681114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2263ca8-bc10-4674-b4c8-2b5dcd1291b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:48.684033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d2263ca8-bc10-4674-b4c8-2b5dcd1291b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:48.702536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2263ca8-bc10-4674-b4c8-2b5dcd1291b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:48.704435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2263ca8-bc10-4674-b4c8-2b5dcd1291b0 service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:48.722235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 879/1733] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:48.738373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af64cf-e253-409a-ad08-ac0bc7a2952d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:48.739508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af64cf-e253-409a-ad08-ac0bc7a2952d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:48.740144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af64cf-e253-409a-ad08-ac0bc7a2952d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:48.772400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b30cc-a7fe-46c3-ae06-09fad2a2e7c6 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:48.773069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b30cc-a7fe-46c3-ae06-09fad2a2e7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:48.773352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06b30cc-a7fe-46c3-ae06-09fad2a2e7c6 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:48.775521 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 880/1734] 10.222.0.64 () {54 vars in 912 bytes} [Tue Jul 12 13:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:41:48.786380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-05af64cf-e253-409a-ad08-ac0bc7a2952d None None] MFA Rules not processed for user `636181e787714128869124b40ab14c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:48.787850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-05af64cf-e253-409a-ad08-ac0bc7a2952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:48.787980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3badca6-bf94-4b8f-b487-0a1eb98d33e7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:48.788399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3badca6-bf94-4b8f-b487-0a1eb98d33e7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:48.788816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3badca6-bf94-4b8f-b487-0a1eb98d33e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:48.867514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b3badca6-bf94-4b8f-b487-0a1eb98d33e7 None None] MFA Rules not processed for user `bcdda7fcb39248c1a5a36ee699d23c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:48.869422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b3badca6-bf94-4b8f-b487-0a1eb98d33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:48.903509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 881/1735] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:41:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:48.906483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3badca6-bf94-4b8f-b487-0a1eb98d33e7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:48.910041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b3badca6-bf94-4b8f-b487-0a1eb98d33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:48.962354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 855/1736] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:48.962354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af64cf-e253-409a-ad08-ac0bc7a2952d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:48.983649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3badca6-bf94-4b8f-b487-0a1eb98d33e7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:49.000956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af64cf-e253-409a-ad08-ac0bc7a2952d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:49.006744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:49.007050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fbfd4-593b-4dd7-a19d-85e21a7f8d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:49.008133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbfd4-593b-4dd7-a19d-85e21a7f8d3b service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:49.008427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbfd4-593b-4dd7-a19d-85e21a7f8d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:49.008824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fbfd4-593b-4dd7-a19d-85e21a7f8d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:49.017325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:49.017836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:49.018322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] PATH_INFO: `/v3/projects/22a37b78cbd54d80ac72b0cb24314612` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:49.022386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fbfd4-593b-4dd7-a19d-85e21a7f8d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:49.024165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fbfd4-593b-4dd7-a19d-85e21a7f8d3b service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:49.033396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a37b78cbd54d80ac72b0cb24314612)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:49.036936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 856/1737] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:49.037440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:49.248886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a37b78cbd54d80ac72b0cb24314612', 'request_id': 'req-9e163ea2-0d48-4c53-b62f-0194d6843046'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.262638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a37b78cbd54d80ac72b0cb24314612', 'request_id': 'req-9e163ea2-0d48-4c53-b62f-0194d6843046'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.283189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a37b78cbd54d80ac72b0cb24314612', 'request_id': 'req-9e163ea2-0d48-4c53-b62f-0194d6843046'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.303418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] The token cache is being invalidate because project 22a37b78cbd54d80ac72b0cb24314612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:49.306794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.308955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.313837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 882/1738] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:48 2022] DELETE /identity/v3/projects/22a37b78cbd54d80ac72b0cb24314612 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:49.318803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fbfd4-593b-4dd7-a19d-85e21a7f8d3b service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:49.337106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fbfd4-593b-4dd7-a19d-85e21a7f8d3b service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:49.542321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:49.588021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:49.589398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:49.589779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:49.590151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] PATH_INFO: `/v3/users/0698c6052ff140efbea08e88fa85f2bd` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:49.592075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0698c6052ff140efbea08e88fa85f2bd)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:49.594959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:49.708002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0698c6052ff140efbea08e88fa85f2bd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.766549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0698c6052ff140efbea08e88fa85f2bd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.768902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0698c6052ff140efbea08e88fa85f2bd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.790018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0698c6052ff140efbea08e88fa85f2bd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.839383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b8a690a-fe36-4cfb-ba03-75ecb68ea10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0698c6052ff140efbea08e88fa85f2bd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:49.857555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 857/1739] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:49 2022] DELETE /identity/v3/users/0698c6052ff140efbea08e88fa85f2bd => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:50.428191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:50.429678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:50.478459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e163ea2-0d48-4c53-b62f-0194d6843046 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:50.565839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:50.629337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:50.631092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:50.631593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:50.632098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] PATH_INFO: `/v3/users/1f3d43d7a2e0486396b86e9104977b03` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:50.634514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3d43d7a2e0486396b86e9104977b03)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:50.637390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:50.659167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9a9b-f91e-4d6c-b58a-f3cffa47ccf6 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:50.659461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9a9b-f91e-4d6c-b58a-f3cffa47ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:50.660134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9a9b-f91e-4d6c-b58a-f3cffa47ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:50.721255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1efc9a9b-f91e-4d6c-b58a-f3cffa47ccf6 None None] MFA Rules not processed for user `2eb98f1b1bf440ba8c3d10894f5518be`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:50.723367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1efc9a9b-f91e-4d6c-b58a-f3cffa47ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:50.799376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3d43d7a2e0486396b86e9104977b03'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:50.801113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3d43d7a2e0486396b86e9104977b03'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:50.818765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3d43d7a2e0486396b86e9104977b03'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:50.852726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3d43d7a2e0486396b86e9104977b03'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:50.854416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3d43d7a2e0486396b86e9104977b03'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:50.885134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 858/1740] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:50.899267 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa043-f5c1-4727-83c6-729048c5be7e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:50.899844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa043-f5c1-4727-83c6-729048c5be7e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:50.900387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904aa043-f5c1-4727-83c6-729048c5be7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:50.910919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 883/1741] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:50 2022] DELETE /identity/v3/users/1f3d43d7a2e0486396b86e9104977b03 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:50.943952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-904aa043-f5c1-4727-83c6-729048c5be7e None None] MFA Rules not processed for user `2eb98f1b1bf440ba8c3d10894f5518be`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:50.945415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-904aa043-f5c1-4727-83c6-729048c5be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:51.090507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 859/1742] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:51.102184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:51.104445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:51.219590 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4d8e-c7b5-46f3-a5ba-068439da69a3 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:51.220028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4d8e-c7b5-46f3-a5ba-068439da69a3 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:51.220482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd4d8e-c7b5-46f3-a5ba-068439da69a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:51.229695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:51.305186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-92fd4d8e-c7b5-46f3-a5ba-068439da69a3 None None] MFA Rules not processed for user `6bb38e1511e44eca8ebaf7524e4cef80`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:51.308457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-92fd4d8e-c7b5-46f3-a5ba-068439da69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:51.353871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7997c14-73a8-46fc-8b85-b4db00998254 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:51.377324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:51.378365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:51.378799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:51.379243 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:51.407717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:51.409363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:51.438705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 884/1743] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:51.441211 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:51.445680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:51.506164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 860/1744] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:51.507496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4d8e-c7b5-46f3-a5ba-068439da69a3 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:51.521289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-92fd4d8e-c7b5-46f3-a5ba-068439da69a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:51.619404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:51.704241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b1620-6aa0-4740-b688-a4deadc6c34a service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:51.716217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:51.717464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:51.717894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:51.718313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] PATH_INFO: `/v3/projects/480a690191904abc9a571eb1926dc49e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:51.720069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=480a690191904abc9a571eb1926dc49e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:51.723207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:51.823047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd4d8e-c7b5-46f3-a5ba-068439da69a3 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:51.838655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:51.840156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:51.840554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:51.841107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] PATH_INFO: `/v3/projects/46f93d3a905e48059e99cc72c355dd6d` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:51.843520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f93d3a905e48059e99cc72c355dd6d)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:51.845595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:51.910321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '480a690191904abc9a571eb1926dc49e', 'request_id': 'req-e3677dc5-41c7-4648-9b67-834669b3a345'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:51.934730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '480a690191904abc9a571eb1926dc49e', 'request_id': 'req-e3677dc5-41c7-4648-9b67-834669b3a345'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:51.958898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '480a690191904abc9a571eb1926dc49e', 'request_id': 'req-e3677dc5-41c7-4648-9b67-834669b3a345'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:51.985212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] The token cache is being invalidate because project 480a690191904abc9a571eb1926dc49e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:51.986204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:51.989609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e3677dc5-41c7-4648-9b67-834669b3a345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.014929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f93d3a905e48059e99cc72c355dd6d', 'request_id': 'req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.020396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 885/1745] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:51 2022] DELETE /identity/v3/projects/480a690191904abc9a571eb1926dc49e => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:52.023044 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50610-224e-4d33-925e-43c0ccd02cc9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:52.023340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50610-224e-4d33-925e-43c0ccd02cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:52.024261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a50610-224e-4d33-925e-43c0ccd02cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:52.033534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f93d3a905e48059e99cc72c355dd6d', 'request_id': 'req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.050801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-20a50610-224e-4d33-925e-43c0ccd02cc9 None None] MFA Rules not processed for user `6bb38e1511e44eca8ebaf7524e4cef80`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:52.052324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-20a50610-224e-4d33-925e-43c0ccd02cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:52.058142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f93d3a905e48059e99cc72c355dd6d', 'request_id': 'req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.093378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] The token cache is being invalidate because project 46f93d3a905e48059e99cc72c355dd6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:52.094995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.096388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-05fad2af-fab1-4c8d-94d9-bd87ccd8bbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.105369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 861/1746] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:51 2022] DELETE /identity/v3/projects/46f93d3a905e48059e99cc72c355dd6d => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:52.114332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cb23-0581-4e8d-adea-a96ea459bae8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:52.114826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cb23-0581-4e8d-adea-a96ea459bae8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:52.115233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8cb23-0581-4e8d-adea-a96ea459bae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:52.165580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-99f8cb23-0581-4e8d-adea-a96ea459bae8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:52.166910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-99f8cb23-0581-4e8d-adea-a96ea459bae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:52.196594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 886/1747] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:52.197969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a50610-224e-4d33-925e-43c0ccd02cc9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:52.206073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-20a50610-224e-4d33-925e-43c0ccd02cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:52.219002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:52.339806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 862/1748] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:52.349979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782235ac-060a-47a1-b3ac-814be9c7fb54 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:52.350530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782235ac-060a-47a1-b3ac-814be9c7fb54 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:52.350999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782235ac-060a-47a1-b3ac-814be9c7fb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:52.351098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a50610-224e-4d33-925e-43c0ccd02cc9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:52.367074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:52.370817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:52.371137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:52.371422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] PATH_INFO: `/v3/users/9979c38bfabe433197e31988399bb332` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:52.379107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9979c38bfabe433197e31988399bb332)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:52.385830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:52.417145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-782235ac-060a-47a1-b3ac-814be9c7fb54 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:52.418823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-782235ac-060a-47a1-b3ac-814be9c7fb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:52.441125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 863/1749] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:52.445100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782235ac-060a-47a1-b3ac-814be9c7fb54 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:52.457086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:52.464280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782235ac-060a-47a1-b3ac-814be9c7fb54 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:52.480923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:52.484701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:52.485369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:52.485835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:52.486883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:52.489239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:52.495772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:52.550914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 864/1750] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:52.553361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:52.555857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9979c38bfabe433197e31988399bb332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.559466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9979c38bfabe433197e31988399bb332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.561232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:52.575862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9979c38bfabe433197e31988399bb332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.608761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9979c38bfabe433197e31988399bb332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.613945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-5326a9ef-8e80-4912-a532-826f0247b734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9979c38bfabe433197e31988399bb332'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:52.654165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 887/1751] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:41:52 2022] DELETE /identity/v3/users/9979c38bfabe433197e31988399bb332 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:52.655811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503e9ad-3c2e-4090-b320-abdfeabd49b9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:52.656277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503e9ad-3c2e-4090-b320-abdfeabd49b9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:52.656809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503e9ad-3c2e-4090-b320-abdfeabd49b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:52.795112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1503e9ad-3c2e-4090-b320-abdfeabd49b9 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:52.798445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1503e9ad-3c2e-4090-b320-abdfeabd49b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:52.827889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c7ff35-5d31-4b6c-b282-c8f4cd611241 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:53.020322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:53.021823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:53.022299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:53.022766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:53.027971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:53.056593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 888/1752] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:41:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:53.059425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503e9ad-3c2e-4090-b320-abdfeabd49b9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:53.061817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1503e9ad-3c2e-4090-b320-abdfeabd49b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:53.226333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:53.282212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503e9ad-3c2e-4090-b320-abdfeabd49b9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:53.309801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:53.311494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71006-c722-45ae-b326-e12794c7c198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:53.313638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71006-c722-45ae-b326-e12794c7c198 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:53.314895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71006-c722-45ae-b326-e12794c7c198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:53.315230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f71006-c722-45ae-b326-e12794c7c198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:53.315512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:53.316934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f71006-c722-45ae-b326-e12794c7c198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:53.331588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f71006-c722-45ae-b326-e12794c7c198 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:53.356953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 865/1753] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 805 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:53.358178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:53.360802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:53.362642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:53.409925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 889/1754] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:53 2022] POST /identity/v3/projects => generated 379 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:53.410542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9eaa09-af84-468e-b15b-415aa797e70e service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:53.411394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71006-c722-45ae-b326-e12794c7c198 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:53.672329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:53.673723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:53.674013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:53.674277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] PATH_INFO: `/v3/projects/ae46ac1b365a464d9796bdfc8938b986` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:53.678002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f71006-c722-45ae-b326-e12794c7c198 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:53.678515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae46ac1b365a464d9796bdfc8938b986)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:53.684408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:53.688434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:53.691785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:53.692080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:53.692367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:53.695841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:53.703641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:53.762449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 890/1755] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:53 2022] POST /identity/v3/users => generated 290 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:53.763502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:53.775882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:53.887424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae46ac1b365a464d9796bdfc8938b986', 'request_id': 'req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:53.912101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae46ac1b365a464d9796bdfc8938b986', 'request_id': 'req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:53.936964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae46ac1b365a464d9796bdfc8938b986', 'request_id': 'req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:53.978446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] The token cache is being invalidate because project ae46ac1b365a464d9796bdfc8938b986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:41:53.978778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:53.985405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:41:53.993264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 866/1756] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:41:53 2022] DELETE /identity/v3/projects/ae46ac1b365a464d9796bdfc8938b986 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:53.998112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:54.005983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:54.048218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf9c84-9107-4d0b-8be5-1f57c0b52ab1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:54.115970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:54.135867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c242a-80e9-4125-8e8c-aceedd5d872d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:54.136556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c242a-80e9-4125-8e8c-aceedd5d872d service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.136846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c242a-80e9-4125-8e8c-aceedd5d872d service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.137123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c242a-80e9-4125-8e8c-aceedd5d872d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.140561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1e0c242a-80e9-4125-8e8c-aceedd5d872d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:54.198323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a624d4a-a6bb-4f8d-a5dd-c56cd59936af admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:54.210928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bde8d3-659d-4605-8b8a-2c649d93cd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:54.211876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde8d3-659d-4605-8b8a-2c649d93cd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.212256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde8d3-659d-4605-8b8a-2c649d93cd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.212633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bde8d3-659d-4605-8b8a-2c649d93cd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.213550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bde8d3-659d-4605-8b8a-2c649d93cd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:54.216561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bde8d3-659d-4605-8b8a-2c649d93cd30 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:54.247411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 867/1757] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:53 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:54.247411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cf446-88dc-43d0-93c2-e234fae85d09 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.247411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cf446-88dc-43d0-93c2-e234fae85d09 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.247411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68cf446-88dc-43d0-93c2-e234fae85d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.267555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:54.288119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f68cf446-88dc-43d0-93c2-e234fae85d09 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:54.292475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f68cf446-88dc-43d0-93c2-e234fae85d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:54.313426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 868/1758] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:54.314390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cf446-88dc-43d0-93c2-e234fae85d09 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:54.330727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c242a-80e9-4125-8e8c-aceedd5d872d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:54.339421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c242a-80e9-4125-8e8c-aceedd5d872d service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:54.344572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68cf446-88dc-43d0-93c2-e234fae85d09 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:54.365271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ae89-77e7-46cf-8236-f8adbd1a113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:54.367167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ae89-77e7-46cf-8236-f8adbd1a113d admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.367780 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ae89-77e7-46cf-8236-f8adbd1a113d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.368394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ae89-77e7-46cf-8236-f8adbd1a113d admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.370091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ae89-77e7-46cf-8236-f8adbd1a113d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:54.373093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 891/1759] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:41:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:41:54.373433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ae89-77e7-46cf-8236-f8adbd1a113d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:54.375863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb236d-57a5-4a51-9078-55a89ea1a52e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.375941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb236d-57a5-4a51-9078-55a89ea1a52e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.376284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb236d-57a5-4a51-9078-55a89ea1a52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.394118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 869/1760] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:54.399531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ae89-77e7-46cf-8236-f8adbd1a113d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:54.441067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9cfb236d-57a5-4a51-9078-55a89ea1a52e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:54.442333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9cfb236d-57a5-4a51-9078-55a89ea1a52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:54.461073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 892/1761] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:54.466473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb236d-57a5-4a51-9078-55a89ea1a52e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:54.501881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb236d-57a5-4a51-9078-55a89ea1a52e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:54.515398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:54.519930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.520658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.521105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.522051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:54.522496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:54.526450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ae89-77e7-46cf-8236-f8adbd1a113d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:54.529150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:54.578936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 893/1762] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:54.582426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:54.582802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8b57b-5b9a-40e7-994d-1d2d04dcdc5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:54.597899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b57b-5b9a-40e7-994d-1d2d04dcdc5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.598257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b57b-5b9a-40e7-994d-1d2d04dcdc5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.598571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8b57b-5b9a-40e7-994d-1d2d04dcdc5f admin admin] PATH_INFO: `/v3/projects/d9396d036bc3473890ce4395cadd835c/users/662886ca5fbd41f1917fe77f328faccc/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.608915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb8bf-d9ed-40d0-af48-b094b7fd7c3c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:54.616123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d71176-22a3-4fc8-b52e-fb37703dddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:54.617581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71176-22a3-4fc8-b52e-fb37703dddf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.618565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71176-22a3-4fc8-b52e-fb37703dddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.618992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d71176-22a3-4fc8-b52e-fb37703dddf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.619906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d71176-22a3-4fc8-b52e-fb37703dddf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:54.622245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d71176-22a3-4fc8-b52e-fb37703dddf5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:54.715497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8b57b-5b9a-40e7-994d-1d2d04dcdc5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9396d036bc3473890ce4395cadd835c, user_id=662886ca5fbd41f1917fe77f328faccc, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:54.718842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8b57b-5b9a-40e7-994d-1d2d04dcdc5f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:54.730087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 894/1763] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:54 2022] POST /identity/v3/projects => generated 363 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:54.742724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d71176-22a3-4fc8-b52e-fb37703dddf5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:54.801427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 870/1764] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:54 2022] PUT /identity/v3/projects/d9396d036bc3473890ce4395cadd835c/users/662886ca5fbd41f1917fe77f328faccc/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:54.803412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840bf0-5366-43e8-bc06-196ee802134a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:54.810658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840bf0-5366-43e8-bc06-196ee802134a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:54.811854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12840bf0-5366-43e8-bc06-196ee802134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:54.925048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-12840bf0-5366-43e8-bc06-196ee802134a None None] MFA Rules not processed for user `662886ca5fbd41f1917fe77f328faccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:54.930721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-12840bf0-5366-43e8-bc06-196ee802134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:55.026347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d71176-22a3-4fc8-b52e-fb37703dddf5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:55.249835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 871/1765] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 447 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:55.250817 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12840bf0-5366-43e8-bc06-196ee802134a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:55.301416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e75435-477a-4477-80e7-e7ed6794fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:55.302126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e75435-477a-4477-80e7-e7ed6794fc61 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:55.302564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e75435-477a-4477-80e7-e7ed6794fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:55.305016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e75435-477a-4477-80e7-e7ed6794fc61 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:55.305810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e75435-477a-4477-80e7-e7ed6794fc61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:55.316730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e75435-477a-4477-80e7-e7ed6794fc61 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:55.368226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:55.386957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 895/1766] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:54 2022] POST /identity/v3/users => generated 282 bytes in 656 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:55.393425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e75435-477a-4477-80e7-e7ed6794fc61 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:55.430226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e75435-477a-4477-80e7-e7ed6794fc61 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:55.485926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4701f4-634f-40a5-86bc-fc79fbd54839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:55.493366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4701f4-634f-40a5-86bc-fc79fbd54839 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:55.495917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4701f4-634f-40a5-86bc-fc79fbd54839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:55.500175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4701f4-634f-40a5-86bc-fc79fbd54839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:55.501013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4701f4-634f-40a5-86bc-fc79fbd54839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:55.517409 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4701f4-634f-40a5-86bc-fc79fbd54839 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:55.591292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12840bf0-5366-43e8-bc06-196ee802134a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:55.596246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 896/1767] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:55.597891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4701f4-634f-40a5-86bc-fc79fbd54839 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:55.616374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5b150-8abf-449c-ace9-19f83be0d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:55.617086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5b150-8abf-449c-ace9-19f83be0d2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:55.617372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5b150-8abf-449c-ace9-19f83be0d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:55.617648 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5b150-8abf-449c-ace9-19f83be0d2e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:55.618362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5b150-8abf-449c-ace9-19f83be0d2e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:55.630930 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5b150-8abf-449c-ace9-19f83be0d2e8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:55.636703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4701f4-634f-40a5-86bc-fc79fbd54839 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:55.681968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4492a1-264c-4ad2-9b0c-87e21a130d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:55.684472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4492a1-264c-4ad2-9b0c-87e21a130d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:55.684780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4492a1-264c-4ad2-9b0c-87e21a130d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:55.685042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4492a1-264c-4ad2-9b0c-87e21a130d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:55.685806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4492a1-264c-4ad2-9b0c-87e21a130d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:55.687532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4492a1-264c-4ad2-9b0c-87e21a130d81 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:55.746123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 897/1768] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:55.747790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4492a1-264c-4ad2-9b0c-87e21a130d81 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:55.749692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 872/1769] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:55 2022] POST /identity/v3/projects => generated 381 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:55.758647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5b150-8abf-449c-ace9-19f83be0d2e8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:55.792899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4492a1-264c-4ad2-9b0c-87e21a130d81 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:55.939330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:56.023626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5b150-8abf-449c-ace9-19f83be0d2e8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:56.040773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123412e-1f68-4581-a282-c9d3e80a298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:56.041552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123412e-1f68-4581-a282-c9d3e80a298c admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:56.041838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123412e-1f68-4581-a282-c9d3e80a298c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:56.042113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123412e-1f68-4581-a282-c9d3e80a298c admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:56.043661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123412e-1f68-4581-a282-c9d3e80a298c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:56.045665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123412e-1f68-4581-a282-c9d3e80a298c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:56.087961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 873/1770] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:55 2022] POST /identity/v3/users => generated 297 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:56.092773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123412e-1f68-4581-a282-c9d3e80a298c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:56.095775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71cf72f-8d3f-4e6b-ba58-30c54ab6a942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:56.097710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf72f-8d3f-4e6b-ba58-30c54ab6a942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:56.100122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf72f-8d3f-4e6b-ba58-30c54ab6a942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:56.106865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71cf72f-8d3f-4e6b-ba58-30c54ab6a942 admin admin] PATH_INFO: `/v3/projects/518b07c1a2964e109deed3c8e37f8774/users/4e5b3a44513c4f55b468312b41667552/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:56.115319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123412e-1f68-4581-a282-c9d3e80a298c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:56.140210 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948bde1-a789-4fe8-b2eb-da4a2dc4c123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:56.140910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948bde1-a789-4fe8-b2eb-da4a2dc4c123 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:56.141792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948bde1-a789-4fe8-b2eb-da4a2dc4c123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:56.141792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948bde1-a789-4fe8-b2eb-da4a2dc4c123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:56.142349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948bde1-a789-4fe8-b2eb-da4a2dc4c123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:56.147767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948bde1-a789-4fe8-b2eb-da4a2dc4c123 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:56.174736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cf72f-8d3f-4e6b-ba58-30c54ab6a942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=518b07c1a2964e109deed3c8e37f8774, user_id=4e5b3a44513c4f55b468312b41667552, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:56.184003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 874/1771] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:56.184914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948bde1-a789-4fe8-b2eb-da4a2dc4c123 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:56.197495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71cf72f-8d3f-4e6b-ba58-30c54ab6a942 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:56.246691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948bde1-a789-4fe8-b2eb-da4a2dc4c123 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:56.247238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 898/1772] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:55 2022] PUT /identity/v3/projects/518b07c1a2964e109deed3c8e37f8774/users/4e5b3a44513c4f55b468312b41667552/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:56.258439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f30e-7e43-4396-9f4e-ee7dea5d6b47 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:56.258891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f30e-7e43-4396-9f4e-ee7dea5d6b47 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:56.259276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323f30e-7e43-4396-9f4e-ee7dea5d6b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:56.338497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1323f30e-7e43-4396-9f4e-ee7dea5d6b47 None None] MFA Rules not processed for user `4e5b3a44513c4f55b468312b41667552`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:56.349569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1323f30e-7e43-4396-9f4e-ee7dea5d6b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:56.537531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6fe29-7814-4d89-b230-8491e59d4ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:56.547977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6fe29-7814-4d89-b230-8491e59d4ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:56.548272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6fe29-7814-4d89-b230-8491e59d4ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:56.548557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6fe29-7814-4d89-b230-8491e59d4ae7 admin admin] PATH_INFO: `/v3/projects/46837ee33b74480ebac98b5f3f6f7ff7/users/16d4db1c2dba4f328d9ab4aea7ccfbbf/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:56.608597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6fe29-7814-4d89-b230-8491e59d4ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46837ee33b74480ebac98b5f3f6f7ff7, user_id=16d4db1c2dba4f328d9ab4aea7ccfbbf, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:56.611828 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6fe29-7814-4d89-b230-8491e59d4ae7 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:56.678410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 875/1773] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:56 2022] PUT /identity/v3/projects/46837ee33b74480ebac98b5f3f6f7ff7/users/16d4db1c2dba4f328d9ab4aea7ccfbbf/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:56.683130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6fe29-7814-4d89-b230-8491e59d4ae7 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:56.697853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 899/1774] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 440 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:56.702289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323f30e-7e43-4396-9f4e-ee7dea5d6b47 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:56.733959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323f30e-7e43-4396-9f4e-ee7dea5d6b47 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:56.838441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:56.885232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250ed2-e8d1-4ef6-a7e0-ac8f95f507bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:56.887829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250ed2-e8d1-4ef6-a7e0-ac8f95f507bd admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:56.888138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250ed2-e8d1-4ef6-a7e0-ac8f95f507bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:56.890356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de250ed2-e8d1-4ef6-a7e0-ac8f95f507bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:56.894546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250ed2-e8d1-4ef6-a7e0-ac8f95f507bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:56.899134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de250ed2-e8d1-4ef6-a7e0-ac8f95f507bd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:56.943929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6fe29-7814-4d89-b230-8491e59d4ae7 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:56.970973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 900/1775] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:56 2022] POST /identity/v3/projects => generated 365 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:56.974792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250ed2-e8d1-4ef6-a7e0-ac8f95f507bd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:56.991879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef9a4-3b3d-47f6-bd22-7143c38e63a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:56.992996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef9a4-3b3d-47f6-bd22-7143c38e63a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:56.992996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef9a4-3b3d-47f6-bd22-7143c38e63a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:56.993193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feef9a4-3b3d-47f6-bd22-7143c38e63a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:56.993959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feef9a4-3b3d-47f6-bd22-7143c38e63a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:57.024093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feef9a4-3b3d-47f6-bd22-7143c38e63a8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:57.062284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 876/1776] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:57.073070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef9a4-3b3d-47f6-bd22-7143c38e63a8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:57.122713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feef9a4-3b3d-47f6-bd22-7143c38e63a8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:57.229472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de250ed2-e8d1-4ef6-a7e0-ac8f95f507bd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:57.249655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca4db-1398-4819-aae7-306ea1adfc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:57.255461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca4db-1398-4819-aae7-306ea1adfc1c admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:57.255943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca4db-1398-4819-aae7-306ea1adfc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:57.256224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca4db-1398-4819-aae7-306ea1adfc1c admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:57.258101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ca4db-1398-4819-aae7-306ea1adfc1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:57.258665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:57.266367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ca4db-1398-4819-aae7-306ea1adfc1c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:57.334987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 901/1777] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:41:56 2022] POST /identity/v3/users => generated 289 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:41:57.336005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca4db-1398-4819-aae7-306ea1adfc1c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:57.338844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d1d100-4840-43b4-a7ec-c881e59a6f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:57.348501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1d100-4840-43b4-a7ec-c881e59a6f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:57.348779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1d100-4840-43b4-a7ec-c881e59a6f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:57.349067 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d1d100-4840-43b4-a7ec-c881e59a6f3e admin admin] PATH_INFO: `/v3/projects/46837ee33b74480ebac98b5f3f6f7ff7/users/16d4db1c2dba4f328d9ab4aea7ccfbbf/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:57.351920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1d100-4840-43b4-a7ec-c881e59a6f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46837ee33b74480ebac98b5f3f6f7ff7, user_id=16d4db1c2dba4f328d9ab4aea7ccfbbf, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:57.354719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d1d100-4840-43b4-a7ec-c881e59a6f3e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:57.369318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 877/1778] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:57 2022] PUT /identity/v3/projects/46837ee33b74480ebac98b5f3f6f7ff7/users/16d4db1c2dba4f328d9ab4aea7ccfbbf/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:57.386271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca4db-1398-4819-aae7-306ea1adfc1c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:57.387319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a52d-aa75-4e44-a860-abb36d5d9e4f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:57.389764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a52d-aa75-4e44-a860-abb36d5d9e4f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:57.391179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43a52d-aa75-4e44-a860-abb36d5d9e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:57.457953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1f43a52d-aa75-4e44-a860-abb36d5d9e4f None None] MFA Rules not processed for user `16d4db1c2dba4f328d9ab4aea7ccfbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:57.460299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1f43a52d-aa75-4e44-a860-abb36d5d9e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:57.610906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a6f6e-f314-4f14-ad7e-81a921721ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:57.616111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a6f6e-f314-4f14-ad7e-81a921721ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:57.616483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a6f6e-f314-4f14-ad7e-81a921721ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:57.618658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a6f6e-f314-4f14-ad7e-81a921721ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:57.623358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a6f6e-f314-4f14-ad7e-81a921721ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:57.631300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a6f6e-f314-4f14-ad7e-81a921721ac1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:57.689193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 902/1779] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:57.695552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd46f1-ac9b-4773-ba7b-e4f31ba8d6b6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:57.698269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd46f1-ac9b-4773-ba7b-e4f31ba8d6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:57.699422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd46f1-ac9b-4773-ba7b-e4f31ba8d6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:57.787109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-56cd46f1-ac9b-4773-ba7b-e4f31ba8d6b6 None None] MFA Rules not processed for user `2eb98f1b1bf440ba8c3d10894f5518be`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:57.799890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56cd46f1-ac9b-4773-ba7b-e4f31ba8d6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:57.811124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 878/1780] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:57.815490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a52d-aa75-4e44-a860-abb36d5d9e4f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:57.876776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43a52d-aa75-4e44-a860-abb36d5d9e4f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:57.912911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:57.915580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:57.925605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:57.929618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] PATH_INFO: `/v3/projects/dc04e1d42d43462393e0aed2056c4f27/users/1939c5acb9ab4779a5c8a16a2233dc25/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:58.011732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc04e1d42d43462393e0aed2056c4f27, user_id=1939c5acb9ab4779a5c8a16a2233dc25, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:58.022359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:58.059938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 879/1781] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:57 2022] PUT /identity/v3/projects/dc04e1d42d43462393e0aed2056c4f27/users/1939c5acb9ab4779a5c8a16a2233dc25/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:58.061077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:58.067146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:58.156203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 903/1782] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 463 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:58.156203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd46f1-ac9b-4773-ba7b-e4f31ba8d6b6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:58.191321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:58.210863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd46f1-ac9b-4773-ba7b-e4f31ba8d6b6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:58.260932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173558e4-0b5d-4f5c-9332-6b32b04697ad admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:58.274381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbe797-3212-4b56-9053-5efcd643de1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:58.275669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe797-3212-4b56-9053-5efcd643de1d service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:58.276095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe797-3212-4b56-9053-5efcd643de1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:58.276535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbe797-3212-4b56-9053-5efcd643de1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:58.423982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:41:58.461830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f2092-2b85-4148-a327-c9a379c47192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:58.461830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2092-2b85-4148-a327-c9a379c47192 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:58.462523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2092-2b85-4148-a327-c9a379c47192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:58.463000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f2092-2b85-4148-a327-c9a379c47192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:58.464477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f2092-2b85-4148-a327-c9a379c47192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:58.472590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f2092-2b85-4148-a327-c9a379c47192 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:58.500376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 904/1783] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:41:58.501563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbe797-3212-4b56-9053-5efcd643de1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:58.501726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f2092-2b85-4148-a327-c9a379c47192 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:58.504310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbe797-3212-4b56-9053-5efcd643de1d service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:58.525834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f2092-2b85-4148-a327-c9a379c47192 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:58.541558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250b9a-7822-48e5-be0b-b655dd71fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:58.542852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250b9a-7822-48e5-be0b-b655dd71fd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:58.543246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250b9a-7822-48e5-be0b-b655dd71fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:58.543719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4250b9a-7822-48e5-be0b-b655dd71fd56 admin admin] PATH_INFO: `/v3/projects/dc04e1d42d43462393e0aed2056c4f27/users/1939c5acb9ab4779a5c8a16a2233dc25/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:58.547488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250b9a-7822-48e5-be0b-b655dd71fd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc04e1d42d43462393e0aed2056c4f27, user_id=1939c5acb9ab4779a5c8a16a2233dc25, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:58.550310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4250b9a-7822-48e5-be0b-b655dd71fd56 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:58.560885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 880/1784] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:58.597399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f8f03-303a-4b2a-b2f7-0687a6141570 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:58.597699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f8f03-303a-4b2a-b2f7-0687a6141570 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:58.597991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f8f03-303a-4b2a-b2f7-0687a6141570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:58.598352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 905/1785] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:41:58 2022] PUT /identity/v3/projects/dc04e1d42d43462393e0aed2056c4f27/users/1939c5acb9ab4779a5c8a16a2233dc25/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:41:58.697310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-047f8f03-303a-4b2a-b2f7-0687a6141570 None None] MFA Rules not processed for user `1939c5acb9ab4779a5c8a16a2233dc25`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:58.725905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-047f8f03-303a-4b2a-b2f7-0687a6141570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:59.021494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 881/1786] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:41:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:41:59.031122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250b9a-7822-48e5-be0b-b655dd71fd56 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:59.290260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4250b9a-7822-48e5-be0b-b655dd71fd56 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:59.302066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bca411-2389-4eb8-bf0d-be12c5bff603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:59.303151 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca411-2389-4eb8-bf0d-be12c5bff603 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:59.304342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca411-2389-4eb8-bf0d-be12c5bff603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:59.306501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bca411-2389-4eb8-bf0d-be12c5bff603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:59.341654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bca411-2389-4eb8-bf0d-be12c5bff603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:59.345109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bca411-2389-4eb8-bf0d-be12c5bff603 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:59.382460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 906/1787] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:41:59.438251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f8f03-303a-4b2a-b2f7-0687a6141570 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:59.501585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177814-efae-42a4-a537-0911080def60 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:59.502094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177814-efae-42a4-a537-0911080def60 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:59.502536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51177814-efae-42a4-a537-0911080def60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:59.554648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-51177814-efae-42a4-a537-0911080def60 None None] MFA Rules not processed for user `bcdda7fcb39248c1a5a36ee699d23c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:41:59.556975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-51177814-efae-42a4-a537-0911080def60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:59.740794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f8f03-303a-4b2a-b2f7-0687a6141570 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:59.761396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d4db1c2dba4f328d9ab4aea7ccfbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46837ee33b74480ebac98b5f3f6f7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:59.765021 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:59.769740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:59.771935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:59.772921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:41:59.774183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:59.777374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:59.797829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 907/1788] 10.222.0.67 () {58 vars in 1015 bytes} [Tue Jul 12 13:41:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:41:59.823993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 882/1789] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:41:59.834166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51177814-efae-42a4-a537-0911080def60 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:59.880425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:41:59.882434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:41:59.887310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51177814-efae-42a4-a537-0911080def60 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:59.911276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a2e17-8ebd-4300-b9e1-fc23567e7521 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:41:59.912832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d4db1c2dba4f328d9ab4aea7ccfbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46837ee33b74480ebac98b5f3f6f7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:59.915401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:59.915942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:59.917166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:59.919278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:59.924791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:41:59.925694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a1ea-c669-4df4-9c77-8c8b3049367c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:41:59.926612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a1ea-c669-4df4-9c77-8c8b3049367c service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:41:59.927106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a1ea-c669-4df4-9c77-8c8b3049367c service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:41:59.927620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833a1ea-c669-4df4-9c77-8c8b3049367c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:41:59.962529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833a1ea-c669-4df4-9c77-8c8b3049367c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:41:59.964862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833a1ea-c669-4df4-9c77-8c8b3049367c service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:00.003054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 883/1790] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:41:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:00.039702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 908/1791] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:41:59 2022] POST /identity/v3/projects => generated 354 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:00.041369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a1ea-c669-4df4-9c77-8c8b3049367c service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:00.061231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833a1ea-c669-4df4-9c77-8c8b3049367c service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:00.175412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:00.213332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d4db1c2dba4f328d9ab4aea7ccfbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46837ee33b74480ebac98b5f3f6f7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:00.214032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:00.217119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:00.217454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:00.218229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:00.218550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:00.220256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:00.267159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:00.270968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:00.271928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 884/1792] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:00.358813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:00.397898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:00.411175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0e037-a082-460f-81a5-efc5c3d4ab20 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:00.436802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16d4db1c2dba4f328d9ab4aea7ccfbbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '46837ee33b74480ebac98b5f3f6f7ff7', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:00.437703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:00.437988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:00.438325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] PATH_INFO: `/v3/projects/b09fa37582d549b6ac95dd551ba9b526` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:00.444027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b09fa37582d549b6ac95dd551ba9b526)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:00.446036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:00.447749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c01c4-f000-4e82-a737-23fc39369eb9 tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:00.452157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fcbaf-3f2c-447f-96ff-2e9237b67107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:00.456704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fcbaf-3f2c-447f-96ff-2e9237b67107 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:00.456704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fcbaf-3f2c-447f-96ff-2e9237b67107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:00.456704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341fcbaf-3f2c-447f-96ff-2e9237b67107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:00.469879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fcbaf-3f2c-447f-96ff-2e9237b67107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:00.472944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341fcbaf-3f2c-447f-96ff-2e9237b67107 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:00.485440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 909/1793] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:00.486320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fcbaf-3f2c-447f-96ff-2e9237b67107 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:00.584827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b09fa37582d549b6ac95dd551ba9b526', 'request_id': 'req-64e356f3-61f7-479d-8b94-c2eefd3560ae'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:00.598463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b09fa37582d549b6ac95dd551ba9b526', 'request_id': 'req-64e356f3-61f7-479d-8b94-c2eefd3560ae'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:00.614420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b09fa37582d549b6ac95dd551ba9b526', 'request_id': 'req-64e356f3-61f7-479d-8b94-c2eefd3560ae'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:00.664761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] The token cache is being invalidate because project b09fa37582d549b6ac95dd551ba9b526 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:00.665047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:00.668206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341fcbaf-3f2c-447f-96ff-2e9237b67107 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:00.669164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-64e356f3-61f7-479d-8b94-c2eefd3560ae tempest-VolumeQuotaClassesTest-1103554285 tempest-VolumeQuotaClassesTest-1103554285-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:00.675487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 885/1794] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:00 2022] DELETE /identity/v3/projects/b09fa37582d549b6ac95dd551ba9b526 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:00.833115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:00.835073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:00.835490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:00.835961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] PATH_INFO: `/v3/users/4e5b3a44513c4f55b468312b41667552` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:00.837554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5b3a44513c4f55b468312b41667552)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:00.840735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:01.037644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5b3a44513c4f55b468312b41667552'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.038480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5b3a44513c4f55b468312b41667552'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.056232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5b3a44513c4f55b468312b41667552'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.076781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5b3a44513c4f55b468312b41667552'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.078570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5b3a44513c4f55b468312b41667552'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.089022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:01.131423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 910/1795] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:00 2022] DELETE /identity/v3/users/4e5b3a44513c4f55b468312b41667552 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:01.138520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49755b42-6b00-4d4f-8866-2703522bc34f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:01.139004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49755b42-6b00-4d4f-8866-2703522bc34f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:01.139096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49755b42-6b00-4d4f-8866-2703522bc34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:01.197303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-49755b42-6b00-4d4f-8866-2703522bc34f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:01.201674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-49755b42-6b00-4d4f-8866-2703522bc34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:01.269113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:01.270565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:01.420479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 886/1796] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:01.464192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49755b42-6b00-4d4f-8866-2703522bc34f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:01.466207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-49755b42-6b00-4d4f-8866-2703522bc34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:01.517676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439008f-6856-40f9-b068-e8252eef4b8c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:01.534895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:01.538205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:01.538725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:01.539182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] PATH_INFO: `/v3/users/662886ca5fbd41f1917fe77f328faccc` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:01.574945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=662886ca5fbd41f1917fe77f328faccc)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:01.577388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:01.676429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49755b42-6b00-4d4f-8866-2703522bc34f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:01.681100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0742816-0a85-4177-833c-a7b463eeff9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:01.682139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742816-0a85-4177-833c-a7b463eeff9b service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:01.682644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742816-0a85-4177-833c-a7b463eeff9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:01.683290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0742816-0a85-4177-833c-a7b463eeff9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:01.698581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '662886ca5fbd41f1917fe77f328faccc'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.699325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '662886ca5fbd41f1917fe77f328faccc'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.708623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0742816-0a85-4177-833c-a7b463eeff9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:01.711237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0742816-0a85-4177-833c-a7b463eeff9b service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:01.730282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '662886ca5fbd41f1917fe77f328faccc'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.731957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 887/1797] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:01.747820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '662886ca5fbd41f1917fe77f328faccc'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.748932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '662886ca5fbd41f1917fe77f328faccc'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:01.788581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66791f1-d31c-430e-996c-9a2b73e2411a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:01.789946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66791f1-d31c-430e-996c-9a2b73e2411a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:01.790913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66791f1-d31c-430e-996c-9a2b73e2411a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:01.793140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 911/1798] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:01 2022] DELETE /identity/v3/users/662886ca5fbd41f1917fe77f328faccc => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:01.825712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:01.849197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d66791f1-d31c-430e-996c-9a2b73e2411a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:01.853479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d66791f1-d31c-430e-996c-9a2b73e2411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:02.053170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 888/1799] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:02.122285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:02.123926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:02.383973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b20cfa-3f07-4fbf-af3e-dfd1c989d935 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:02.398605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a724b5-586a-473d-8874-0beb5afad280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:02.399511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a724b5-586a-473d-8874-0beb5afad280 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:02.401384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a724b5-586a-473d-8874-0beb5afad280 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:02.401695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a724b5-586a-473d-8874-0beb5afad280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:02.435809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a724b5-586a-473d-8874-0beb5afad280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:02.440269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a724b5-586a-473d-8874-0beb5afad280 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:02.478530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 912/1800] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:05.168358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66791f1-d31c-430e-996c-9a2b73e2411a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:05.170112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d66791f1-d31c-430e-996c-9a2b73e2411a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:05.191454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66791f1-d31c-430e-996c-9a2b73e2411a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:05.209387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:05.224396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:05.224832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:05.225180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] PATH_INFO: `/v3/projects/518b07c1a2964e109deed3c8e37f8774` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:05.227536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=518b07c1a2964e109deed3c8e37f8774)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:05.230029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:05.407829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '518b07c1a2964e109deed3c8e37f8774', 'request_id': 'req-3dca836c-acda-48ee-914f-7895e23c7af3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.448468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '518b07c1a2964e109deed3c8e37f8774', 'request_id': 'req-3dca836c-acda-48ee-914f-7895e23c7af3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.459077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '518b07c1a2964e109deed3c8e37f8774', 'request_id': 'req-3dca836c-acda-48ee-914f-7895e23c7af3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.513776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] The token cache is being invalidate because project 518b07c1a2964e109deed3c8e37f8774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:05.513972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.518902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.525369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 889/1801] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:05 2022] DELETE /identity/v3/projects/518b07c1a2964e109deed3c8e37f8774 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:05.530440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a724b5-586a-473d-8874-0beb5afad280 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:05.551442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a724b5-586a-473d-8874-0beb5afad280 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:05.572833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:05.798554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:05.802842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:05.803422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:05.803918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] PATH_INFO: `/v3/users/1939c5acb9ab4779a5c8a16a2233dc25` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:05.807314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1939c5acb9ab4779a5c8a16a2233dc25)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:05.813985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:05.929467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1939c5acb9ab4779a5c8a16a2233dc25'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.930352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1939c5acb9ab4779a5c8a16a2233dc25'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.953019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1939c5acb9ab4779a5c8a16a2233dc25'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.984763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1939c5acb9ab4779a5c8a16a2233dc25'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:05.990063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-8743f86e-029a-4d43-8b83-6a004dc32904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1939c5acb9ab4779a5c8a16a2233dc25'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:06.031294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 913/1802] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:05 2022] DELETE /identity/v3/users/1939c5acb9ab4779a5c8a16a2233dc25 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:06.334569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:06.336140 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:06.362819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca836c-acda-48ee-914f-7895e23c7af3 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:06.641849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:06.642819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:06.643101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:06.644980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] PATH_INFO: `/v3/projects/d9396d036bc3473890ce4395cadd835c` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:06.652539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9396d036bc3473890ce4395cadd835c)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:06.652539 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:06.738111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b669-741e-47a3-8e8b-888e26044e5a None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:06.738978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b669-741e-47a3-8e8b-888e26044e5a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:06.739420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51b669-741e-47a3-8e8b-888e26044e5a None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:06.742244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 914/1803] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:42:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:42:06.760054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:06.802275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9396d036bc3473890ce4395cadd835c', 'request_id': 'req-97b07608-cc54-4426-9a28-e95d3e9a3195'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:06.818158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9396d036bc3473890ce4395cadd835c', 'request_id': 'req-97b07608-cc54-4426-9a28-e95d3e9a3195'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:06.828944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9396d036bc3473890ce4395cadd835c', 'request_id': 'req-97b07608-cc54-4426-9a28-e95d3e9a3195'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:06.833267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24379-272b-4a3c-b8f7-d9336836001d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:06.833909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24379-272b-4a3c-b8f7-d9336836001d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:06.834386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c24379-272b-4a3c-b8f7-d9336836001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:06.867589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-25c24379-272b-4a3c-b8f7-d9336836001d None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:06.869217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-25c24379-272b-4a3c-b8f7-d9336836001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:06.877065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] The token cache is being invalidate because project d9396d036bc3473890ce4395cadd835c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:06.877363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:06.880843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:06.890441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 890/1804] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:06 2022] DELETE /identity/v3/projects/d9396d036bc3473890ce4395cadd835c => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:06.891729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:06.894731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:07.030242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 915/1805] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:42:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:07.074126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b07608-cc54-4426-9a28-e95d3e9a3195 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:07.081571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:07.082566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:07.083104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:07.083403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] PATH_INFO: `/v3/users/16d4db1c2dba4f328d9ab4aea7ccfbbf` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:07.084698 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16d4db1c2dba4f328d9ab4aea7ccfbbf)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:07.086678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:07.215905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16d4db1c2dba4f328d9ab4aea7ccfbbf'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:07.234062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16d4db1c2dba4f328d9ab4aea7ccfbbf'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:07.235696 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16d4db1c2dba4f328d9ab4aea7ccfbbf'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:07.252573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16d4db1c2dba4f328d9ab4aea7ccfbbf'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:07.289258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16d4db1c2dba4f328d9ab4aea7ccfbbf'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:07.305328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 891/1806] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:06 2022] DELETE /identity/v3/users/16d4db1c2dba4f328d9ab4aea7ccfbbf => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:07.979159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5bfbb-0a47-46a2-a762-dde3a8ca2747 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:07.979733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5bfbb-0a47-46a2-a762-dde3a8ca2747 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:07.979868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5bfbb-0a47-46a2-a762-dde3a8ca2747 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:07.981384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 916/1807] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:42:08.121922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:08.125967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:08.248430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:08.319154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a58d0-8205-4992-b3b8-0e97619db1bb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:08.319440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a58d0-8205-4992-b3b8-0e97619db1bb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:08.319904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a58d0-8205-4992-b3b8-0e97619db1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:08.332870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb1a91-b5cc-4bea-9a02-a8cf0501c25e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:08.339947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:08.341211 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:08.341211 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:08.341427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:08.349911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:08.353438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2b4a58d0-8205-4992-b3b8-0e97619db1bb None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:08.354770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2b4a58d0-8205-4992-b3b8-0e97619db1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:08.372048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:08.373611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:08.381275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 917/1808] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:42:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:08.392265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 892/1809] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:08.698565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a58d0-8205-4992-b3b8-0e97619db1bb None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:08.700330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2b4a58d0-8205-4992-b3b8-0e97619db1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:08.717098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:08.777166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:08.778993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:08.796107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1b8c1-88b3-4208-95cc-079bee37a2bf service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:08.804209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57602f-9c13-497b-80fb-201b4412cf6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:08.804932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57602f-9c13-497b-80fb-201b4412cf6c service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:08.805409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57602f-9c13-497b-80fb-201b4412cf6c service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:08.806040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57602f-9c13-497b-80fb-201b4412cf6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:08.808504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a58d0-8205-4992-b3b8-0e97619db1bb None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:08.816275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:08.818482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57602f-9c13-497b-80fb-201b4412cf6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:08.818760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:08.819256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:08.819741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] PATH_INFO: `/v3/projects/dc04e1d42d43462393e0aed2056c4f27` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:08.820926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57602f-9c13-497b-80fb-201b4412cf6c service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:08.837365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 893/1810] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:08.843698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc04e1d42d43462393e0aed2056c4f27)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:08.846015 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:08.928526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc04e1d42d43462393e0aed2056c4f27', 'request_id': 'req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:08.935902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc04e1d42d43462393e0aed2056c4f27', 'request_id': 'req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:08.947512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc04e1d42d43462393e0aed2056c4f27', 'request_id': 'req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:08.972813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] The token cache is being invalidate because project dc04e1d42d43462393e0aed2056c4f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:08.973486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:08.974314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d47d6f2d-c725-40fc-bd8c-49a1535e3dea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:08.981721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 918/1811] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:08 2022] DELETE /identity/v3/projects/dc04e1d42d43462393e0aed2056c4f27 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:08.982262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4bf74-b68f-4c00-9773-22969d4ec8e0 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:08.982262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4bf74-b68f-4c00-9773-22969d4ec8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:08.982414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c4bf74-b68f-4c00-9773-22969d4ec8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.008243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b4c4bf74-b68f-4c00-9773-22969d4ec8e0 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:09.014784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b4c4bf74-b68f-4c00-9773-22969d4ec8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:09.176181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 894/1812] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:09.178554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace8b8-2900-4ccc-ac1e-26be003768e1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.179089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace8b8-2900-4ccc-ac1e-26be003768e1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.179830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace8b8-2900-4ccc-ac1e-26be003768e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.260703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e7ace8b8-2900-4ccc-ac1e-26be003768e1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:09.262781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e7ace8b8-2900-4ccc-ac1e-26be003768e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:09.285177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4bf74-b68f-4c00-9773-22969d4ec8e0 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.286039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 919/1813] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:09.298288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c4bf74-b68f-4c00-9773-22969d4ec8e0 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.304124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.306155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.307303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.307831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.309358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:09.309902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.312226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.330146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 895/1814] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:09.334624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ace8b8-2900-4ccc-ac1e-26be003768e1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.344069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.347242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:09.349784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ace8b8-2900-4ccc-ac1e-26be003768e1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.370059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76bf01-7ae8-4cb5-bba9-4afc262a0069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.370753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76bf01-7ae8-4cb5-bba9-4afc262a0069 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.371035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76bf01-7ae8-4cb5-bba9-4afc262a0069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.373934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58cfec3-7040-457c-8fda-145bf6db77f8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.374180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76bf01-7ae8-4cb5-bba9-4afc262a0069 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.375110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76bf01-7ae8-4cb5-bba9-4afc262a0069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.379333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76bf01-7ae8-4cb5-bba9-4afc262a0069 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.423953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.427196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.429020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.430062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] PATH_INFO: `/v3/projects/46837ee33b74480ebac98b5f3f6f7ff7` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.436677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=46837ee33b74480ebac98b5f3f6f7ff7)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.439483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.440773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 920/1815] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:09 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:09.452784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76bf01-7ae8-4cb5-bba9-4afc262a0069 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.533876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46837ee33b74480ebac98b5f3f6f7ff7', 'request_id': 'req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:09.549534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46837ee33b74480ebac98b5f3f6f7ff7', 'request_id': 'req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:09.549959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76bf01-7ae8-4cb5-bba9-4afc262a0069 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.559756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46837ee33b74480ebac98b5f3f6f7ff7', 'request_id': 'req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:09.574371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:09.594246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] The token cache is being invalidate because project 46837ee33b74480ebac98b5f3f6f7ff7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:09.594536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:09.599777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3ecb5be8-73a7-411d-8ee7-bdc43e905aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:09.602439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 896/1816] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:09 2022] DELETE /identity/v3/projects/46837ee33b74480ebac98b5f3f6f7ff7 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:09.607048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c048e-9bb1-464b-8ec2-7426437b83d7 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.608468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c048e-9bb1-464b-8ec2-7426437b83d7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.608766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c048e-9bb1-464b-8ec2-7426437b83d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.643083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-568c048e-9bb1-464b-8ec2-7426437b83d7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:09.644354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-568c048e-9bb1-464b-8ec2-7426437b83d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:09.677920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:09.678151 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.679010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.679010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.679283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.680018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.684744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.725157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 921/1817] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:09 2022] POST /identity/v3/users => generated 294 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:09.731741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.735880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:09.755962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071196f7-6b62-4bab-856e-22cb9bbe2708 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.767656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 897/1818] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:09.771269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8787-08e0-46d7-af27-a6e2807c1f0a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.771857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8787-08e0-46d7-af27-a6e2807c1f0a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.772332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c8787-08e0-46d7-af27-a6e2807c1f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.777148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b20a1-5b4a-47a8-a747-4061b99c65fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.777557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b20a1-5b4a-47a8-a747-4061b99c65fd admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.778030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b20a1-5b4a-47a8-a747-4061b99c65fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.778553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b20a1-5b4a-47a8-a747-4061b99c65fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.779263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b20a1-5b4a-47a8-a747-4061b99c65fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.781038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b20a1-5b4a-47a8-a747-4061b99c65fd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.795535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 922/1819] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:09.799537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b20a1-5b4a-47a8-a747-4061b99c65fd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.803253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-a28c8787-08e0-46d7-af27-a6e2807c1f0a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:09.804323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a28c8787-08e0-46d7-af27-a6e2807c1f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:09.818991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 898/1820] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:09.820811 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c8787-08e0-46d7-af27-a6e2807c1f0a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.824573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b20a1-5b4a-47a8-a747-4061b99c65fd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.831955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133638f5-bdae-4754-b2c7-92896526297f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.832258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c8787-08e0-46d7-af27-a6e2807c1f0a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.832984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133638f5-bdae-4754-b2c7-92896526297f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.833499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133638f5-bdae-4754-b2c7-92896526297f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.833870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133638f5-bdae-4754-b2c7-92896526297f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.834993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133638f5-bdae-4754-b2c7-92896526297f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.839845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133638f5-bdae-4754-b2c7-92896526297f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.840002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.840002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.840002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.840002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.840456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:09.840456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.842547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.853343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 923/1821] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:09.858148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133638f5-bdae-4754-b2c7-92896526297f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.860485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 899/1822] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:09.865468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.870903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133638f5-bdae-4754-b2c7-92896526297f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.876688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79416c9-e2ac-48e8-b302-33d04ad6c077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.877675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79416c9-e2ac-48e8-b302-33d04ad6c077 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.878023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79416c9-e2ac-48e8-b302-33d04ad6c077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.878364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79416c9-e2ac-48e8-b302-33d04ad6c077 admin admin] PATH_INFO: `/v3/projects/7f182d19ea6145b2b942a4c06992726b/users/79005cd081a94fb7a9d16742e4f5d384/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.879134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da21912-723f-48f7-bead-0f3dd8284eb0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:09.887103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e76835-caad-436f-be4b-d2415187b9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:09.887861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76835-caad-436f-be4b-d2415187b9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.888121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76835-caad-436f-be4b-d2415187b9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.888405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e76835-caad-436f-be4b-d2415187b9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.889118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e76835-caad-436f-be4b-d2415187b9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.891223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e76835-caad-436f-be4b-d2415187b9b0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.900309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79416c9-e2ac-48e8-b302-33d04ad6c077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f182d19ea6145b2b942a4c06992726b, user_id=79005cd081a94fb7a9d16742e4f5d384, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:09.903135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79416c9-e2ac-48e8-b302-33d04ad6c077 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:09.921154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 924/1823] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:09 2022] PUT /identity/v3/projects/7f182d19ea6145b2b942a4c06992726b/users/79005cd081a94fb7a9d16742e4f5d384/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:09.931715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 900/1824] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:09 2022] POST /identity/v3/projects => generated 393 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:09.932386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc6ff8-b7f2-4e1a-9d06-0bb03046e110 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:09.932386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc6ff8-b7f2-4e1a-9d06-0bb03046e110 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:09.932386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc6ff8-b7f2-4e1a-9d06-0bb03046e110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:09.933556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e76835-caad-436f-be4b-d2415187b9b0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:09.963371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-41cc6ff8-b7f2-4e1a-9d06-0bb03046e110 None None] MFA Rules not processed for user `79005cd081a94fb7a9d16742e4f5d384`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:09.964621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-41cc6ff8-b7f2-4e1a-9d06-0bb03046e110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:10.007907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e76835-caad-436f-be4b-d2415187b9b0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.012706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedada7-551b-475d-be0e-00a8a05aa6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.013385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedada7-551b-475d-be0e-00a8a05aa6dc admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.013716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedada7-551b-475d-be0e-00a8a05aa6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.013994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedada7-551b-475d-be0e-00a8a05aa6dc admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.014690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedada7-551b-475d-be0e-00a8a05aa6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.016657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedada7-551b-475d-be0e-00a8a05aa6dc admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.030453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 925/1825] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:10.034959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc6ff8-b7f2-4e1a-9d06-0bb03046e110 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.036912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 901/1826] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:09 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:10.040540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedada7-551b-475d-be0e-00a8a05aa6dc admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.045225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cc6ff8-b7f2-4e1a-9d06-0bb03046e110 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.049843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b6bec-7abb-4d6b-b7c2-0494ffe284bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.050019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedada7-551b-475d-be0e-00a8a05aa6dc admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.050498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6bec-7abb-4d6b-b7c2-0494ffe284bf admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.050779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6bec-7abb-4d6b-b7c2-0494ffe284bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.051052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b6bec-7abb-4d6b-b7c2-0494ffe284bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.051778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6bec-7abb-4d6b-b7c2-0494ffe284bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.053678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b6bec-7abb-4d6b-b7c2-0494ffe284bf admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.054555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4dea5-735a-4391-8812-59090fd18eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.055247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4dea5-735a-4391-8812-59090fd18eef admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.055480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4dea5-735a-4391-8812-59090fd18eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.055860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b4dea5-735a-4391-8812-59090fd18eef admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.056771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4dea5-735a-4391-8812-59090fd18eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.058378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b4dea5-735a-4391-8812-59090fd18eef admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.068639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 902/1827] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:10.072558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4dea5-735a-4391-8812-59090fd18eef admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.085754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b4dea5-735a-4391-8812-59090fd18eef admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.085936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 926/1828] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:10 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:10.086792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b6bec-7abb-4d6b-b7c2-0494ffe284bf admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.122009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:10.145515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5416af-367d-4302-a9d8-881c0bb3c689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.146298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5416af-367d-4302-a9d8-881c0bb3c689 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.146764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5416af-367d-4302-a9d8-881c0bb3c689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.147236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5416af-367d-4302-a9d8-881c0bb3c689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.148239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5416af-367d-4302-a9d8-881c0bb3c689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.150118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5416af-367d-4302-a9d8-881c0bb3c689 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.151725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:10.154641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b6bec-7abb-4d6b-b7c2-0494ffe284bf admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.158529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a72ec0-7181-455d-b0b9-5b546b7523b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.159308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72ec0-7181-455d-b0b9-5b546b7523b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.159707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72ec0-7181-455d-b0b9-5b546b7523b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.160056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a72ec0-7181-455d-b0b9-5b546b7523b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.160816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a72ec0-7181-455d-b0b9-5b546b7523b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.162959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a72ec0-7181-455d-b0b9-5b546b7523b5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.165311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 903/1829] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:10.169484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5416af-367d-4302-a9d8-881c0bb3c689 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.179952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5416af-367d-4302-a9d8-881c0bb3c689 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.187643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 927/1830] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:10 2022] POST /identity/v3/users => generated 300 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:10.187794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff5b53-e320-4105-9d70-a39a5d27a9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.187794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5b53-e320-4105-9d70-a39a5d27a9d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.187794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5b53-e320-4105-9d70-a39a5d27a9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.187794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff5b53-e320-4105-9d70-a39a5d27a9d9 admin admin] PATH_INFO: `/v3/projects/d41b96e014e14649b0f836fed52d2b2b/users/4be2d87b3e3c420cbcc454fa1a6f1b78/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.189269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a72ec0-7181-455d-b0b9-5b546b7523b5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.200959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a72ec0-7181-455d-b0b9-5b546b7523b5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.205359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5b53-e320-4105-9d70-a39a5d27a9d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41b96e014e14649b0f836fed52d2b2b, user_id=4be2d87b3e3c420cbcc454fa1a6f1b78, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.206073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981a528-458d-4c4e-977d-a8b433fc5be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.206757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981a528-458d-4c4e-977d-a8b433fc5be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.207041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981a528-458d-4c4e-977d-a8b433fc5be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.207316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981a528-458d-4c4e-977d-a8b433fc5be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.208113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981a528-458d-4c4e-977d-a8b433fc5be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.208209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff5b53-e320-4105-9d70-a39a5d27a9d9 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.210692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981a528-458d-4c4e-977d-a8b433fc5be9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.223647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 928/1831] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:10.226421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 904/1832] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:10 2022] PUT /identity/v3/projects/d41b96e014e14649b0f836fed52d2b2b/users/4be2d87b3e3c420cbcc454fa1a6f1b78/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:10.226631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981a528-458d-4c4e-977d-a8b433fc5be9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.237050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4ee1-db10-450d-838a-31fb697462b8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.237375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4ee1-db10-450d-838a-31fb697462b8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.237611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd4ee1-db10-450d-838a-31fb697462b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.241635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981a528-458d-4c4e-977d-a8b433fc5be9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.273074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f5dd4ee1-db10-450d-838a-31fb697462b8 None None] MFA Rules not processed for user `4be2d87b3e3c420cbcc454fa1a6f1b78`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:10.274305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f5dd4ee1-db10-450d-838a-31fb697462b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:10.324922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f42a-932a-49fc-9882-4e08ca939c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.325837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f42a-932a-49fc-9882-4e08ca939c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.326120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f42a-932a-49fc-9882-4e08ca939c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.326406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9f42a-932a-49fc-9882-4e08ca939c01 admin admin] PATH_INFO: `/v3/projects/0fc7d197bac348a0b0b995615899e031/users/26d0fca360cd49dc80a8e2e24c3cedc9/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.340718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9f42a-932a-49fc-9882-4e08ca939c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc7d197bac348a0b0b995615899e031, user_id=26d0fca360cd49dc80a8e2e24c3cedc9, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.343456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9f42a-932a-49fc-9882-4e08ca939c01 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.348487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 905/1833] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:10.353043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4ee1-db10-450d-838a-31fb697462b8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.361494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 929/1834] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:10 2022] PUT /identity/v3/projects/0fc7d197bac348a0b0b995615899e031/users/26d0fca360cd49dc80a8e2e24c3cedc9/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:10.363582 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd4ee1-db10-450d-838a-31fb697462b8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.365198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f42a-932a-49fc-9882-4e08ca939c01 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.430944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756ab59-5f34-412c-9ce2-b6f31b439187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.431723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756ab59-5f34-412c-9ce2-b6f31b439187 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.432012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756ab59-5f34-412c-9ce2-b6f31b439187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.432277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756ab59-5f34-412c-9ce2-b6f31b439187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.432996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756ab59-5f34-412c-9ce2-b6f31b439187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.433204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9f42a-932a-49fc-9882-4e08ca939c01 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.434928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756ab59-5f34-412c-9ce2-b6f31b439187 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.444552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da464-3acf-44ac-bc2d-d1650a01d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.447664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da464-3acf-44ac-bc2d-d1650a01d6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.448093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da464-3acf-44ac-bc2d-d1650a01d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.448386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5da464-3acf-44ac-bc2d-d1650a01d6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.449148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da464-3acf-44ac-bc2d-d1650a01d6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.450790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5da464-3acf-44ac-bc2d-d1650a01d6ca admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.468350 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 930/1835] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:10.470983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da464-3acf-44ac-bc2d-d1650a01d6ca admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.481005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 906/1836] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:10 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:10.482004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756ab59-5f34-412c-9ce2-b6f31b439187 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.483618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5da464-3acf-44ac-bc2d-d1650a01d6ca admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.523724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:10.545866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:10.565358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efe8bf-7c14-4db6-89ac-193a2b50b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.566088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe8bf-7c14-4db6-89ac-193a2b50b636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.566556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe8bf-7c14-4db6-89ac-193a2b50b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.567041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efe8bf-7c14-4db6-89ac-193a2b50b636 admin admin] PATH_INFO: `/v3/projects/0fc7d197bac348a0b0b995615899e031/users/26d0fca360cd49dc80a8e2e24c3cedc9/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.569886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756ab59-5f34-412c-9ce2-b6f31b439187 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.570317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efe8bf-7c14-4db6-89ac-193a2b50b636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fc7d197bac348a0b0b995615899e031, user_id=26d0fca360cd49dc80a8e2e24c3cedc9, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.574072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efe8bf-7c14-4db6-89ac-193a2b50b636 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.575820 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72497bbb-e370-4f5b-abab-a3d28f1372db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.577619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497bbb-e370-4f5b-abab-a3d28f1372db admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.578207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497bbb-e370-4f5b-abab-a3d28f1372db admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.578831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72497bbb-e370-4f5b-abab-a3d28f1372db admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.580277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72497bbb-e370-4f5b-abab-a3d28f1372db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.582981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72497bbb-e370-4f5b-abab-a3d28f1372db admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.603877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 931/1837] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:10 2022] PUT /identity/v3/projects/0fc7d197bac348a0b0b995615899e031/users/26d0fca360cd49dc80a8e2e24c3cedc9/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:10.606381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75662762-f48b-473e-80a9-a49ea9080d5a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.606381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75662762-f48b-473e-80a9-a49ea9080d5a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.606671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75662762-f48b-473e-80a9-a49ea9080d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.617519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 907/1838] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:10 2022] POST /identity/v3/users => generated 303 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:10.621821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72497bbb-e370-4f5b-abab-a3d28f1372db admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.639616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-75662762-f48b-473e-80a9-a49ea9080d5a None None] MFA Rules not processed for user `26d0fca360cd49dc80a8e2e24c3cedc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:10.641540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-75662762-f48b-473e-80a9-a49ea9080d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:10.642033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72497bbb-e370-4f5b-abab-a3d28f1372db admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.721949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.723237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.724075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.724677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.725779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.731453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.743961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 932/1839] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:10.751934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 908/1840] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:10.756726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75662762-f48b-473e-80a9-a49ea9080d5a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.758465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.761095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:10.772778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75662762-f48b-473e-80a9-a49ea9080d5a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.779509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a1f7c-c702-4cc1-b946-555ad5361fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.780902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a1f7c-c702-4cc1-b946-555ad5361fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.781442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a1f7c-c702-4cc1-b946-555ad5361fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.781911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a1f7c-c702-4cc1-b946-555ad5361fa1 admin admin] PATH_INFO: `/v3/projects/a34160ea5096414b969a400bf3b47ce7/users/67cae36f8760404285e7048d81455130/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:10.799060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a1f7c-c702-4cc1-b946-555ad5361fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34160ea5096414b969a400bf3b47ce7, user_id=67cae36f8760404285e7048d81455130, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:10.802705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a1f7c-c702-4cc1-b946-555ad5361fa1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:10.827701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 933/1841] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:10 2022] PUT /identity/v3/projects/a34160ea5096414b969a400bf3b47ce7/users/67cae36f8760404285e7048d81455130/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:10.829618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a1f7c-c702-4cc1-b946-555ad5361fa1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:10.840459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe3913-14d0-476f-9360-4e3457557dcd admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:10.916206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235c18f-3b7b-417c-a83a-412c839760e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:10.925352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235c18f-3b7b-417c-a83a-412c839760e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:10.925352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235c18f-3b7b-417c-a83a-412c839760e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:10.925352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235c18f-3b7b-417c-a83a-412c839760e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.000816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:11.002213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a1f7c-c702-4cc1-b946-555ad5361fa1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:11.016411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c63a6-8a9a-46f1-a022-e27f933615c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:11.018436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c63a6-8a9a-46f1-a022-e27f933615c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:11.018939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c63a6-8a9a-46f1-a022-e27f933615c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:11.019504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c63a6-8a9a-46f1-a022-e27f933615c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.021040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c63a6-8a9a-46f1-a022-e27f933615c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:11.023090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c63a6-8a9a-46f1-a022-e27f933615c3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:11.040829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235c18f-3b7b-417c-a83a-412c839760e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:11.041539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 934/1842] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:11.043028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235c18f-3b7b-417c-a83a-412c839760e8 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:11.043559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c63a6-8a9a-46f1-a022-e27f933615c3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:11.055908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c63a6-8a9a-46f1-a022-e27f933615c3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:11.062156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d307c3-05d3-41f2-a3ea-0263bb2489a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:11.063585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d307c3-05d3-41f2-a3ea-0263bb2489a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:11.064117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d307c3-05d3-41f2-a3ea-0263bb2489a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:11.064597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d307c3-05d3-41f2-a3ea-0263bb2489a6 admin admin] PATH_INFO: `/v3/projects/a34160ea5096414b969a400bf3b47ce7/users/67cae36f8760404285e7048d81455130/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.069831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 909/1843] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:11.080042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d307c3-05d3-41f2-a3ea-0263bb2489a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a34160ea5096414b969a400bf3b47ce7, user_id=67cae36f8760404285e7048d81455130, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:11.085777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d307c3-05d3-41f2-a3ea-0263bb2489a6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:11.110909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 935/1844] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:11 2022] PUT /identity/v3/projects/a34160ea5096414b969a400bf3b47ce7/users/67cae36f8760404285e7048d81455130/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:11.115894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235c18f-3b7b-417c-a83a-412c839760e8 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:11.122953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195ccb3-5852-4ed0-9204-d843905ef64c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:11.123324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195ccb3-5852-4ed0-9204-d843905ef64c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:11.123729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195ccb3-5852-4ed0-9204-d843905ef64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.136570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235c18f-3b7b-417c-a83a-412c839760e8 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:11.144753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:11.160201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8195ccb3-5852-4ed0-9204-d843905ef64c None None] MFA Rules not processed for user `67cae36f8760404285e7048d81455130`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:11.163511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8195ccb3-5852-4ed0-9204-d843905ef64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:11.264717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 936/1845] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:11.276987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195ccb3-5852-4ed0-9204-d843905ef64c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:11.302659 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:11.303571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:11.303908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:11.304189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] PATH_INFO: `/v3/users/79005cd081a94fb7a9d16742e4f5d384` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.305472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=79005cd081a94fb7a9d16742e4f5d384)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:11.307467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:11.355033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195ccb3-5852-4ed0-9204-d843905ef64c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:11.360858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e10d10-958d-4483-8306-f2ebb6275e98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:11.361768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10d10-958d-4483-8306-f2ebb6275e98 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:11.362255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10d10-958d-4483-8306-f2ebb6275e98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:11.362721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e10d10-958d-4483-8306-f2ebb6275e98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.375561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e10d10-958d-4483-8306-f2ebb6275e98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:11.377592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e10d10-958d-4483-8306-f2ebb6275e98 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:11.431019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79005cd081a94fb7a9d16742e4f5d384'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:11.440515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 937/1846] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:42:11.472004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79005cd081a94fb7a9d16742e4f5d384'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:11.472747 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79005cd081a94fb7a9d16742e4f5d384'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:11.491479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79005cd081a94fb7a9d16742e4f5d384'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:11.518202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79005cd081a94fb7a9d16742e4f5d384'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:11.532045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 910/1847] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:11 2022] DELETE /identity/v3/users/79005cd081a94fb7a9d16742e4f5d384 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:11.538629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41283280-8145-47d9-bada-ce0007d55713 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:11.538918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41283280-8145-47d9-bada-ce0007d55713 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:11.539198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41283280-8145-47d9-bada-ce0007d55713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.567984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:11.570139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:11.583258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-41283280-8145-47d9-bada-ce0007d55713 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:11.585218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-41283280-8145-47d9-bada-ce0007d55713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:11.691854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d2265-210f-4aa4-b017-b8a8236287dd admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:11.698092 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:11.699018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:11.700001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:11.700001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.703283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:11.723153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:11.762628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 938/1848] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:11.797153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41283280-8145-47d9-bada-ce0007d55713 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:11.801404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-41283280-8145-47d9-bada-ce0007d55713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:11.820758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:11.822592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:11.848031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 911/1849] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:42:11.895593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:11.954653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41283280-8145-47d9-bada-ce0007d55713 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:11.969136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31446a5-e61e-4930-bb3c-423477747a5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:11.969906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31446a5-e61e-4930-bb3c-423477747a5e service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:11.970276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31446a5-e61e-4930-bb3c-423477747a5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:11.970612 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31446a5-e61e-4930-bb3c-423477747a5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:11.991506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31446a5-e61e-4930-bb3c-423477747a5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:11.993337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31446a5-e61e-4930-bb3c-423477747a5e service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:12.028769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 939/1850] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:12.743160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:12.745456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:12.765739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094bb6-9183-4719-bd11-c122aa87042c service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:12.777093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:12.778673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:12.779099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:12.779549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] PATH_INFO: `/v3/projects/7f182d19ea6145b2b942a4c06992726b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:12.781166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f182d19ea6145b2b942a4c06992726b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:12.783350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:12.851807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f182d19ea6145b2b942a4c06992726b', 'request_id': 'req-ac16c0db-7ef2-4d78-867d-7e23a082e036'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:12.862223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f182d19ea6145b2b942a4c06992726b', 'request_id': 'req-ac16c0db-7ef2-4d78-867d-7e23a082e036'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:12.871947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f182d19ea6145b2b942a4c06992726b', 'request_id': 'req-ac16c0db-7ef2-4d78-867d-7e23a082e036'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:12.889024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] The token cache is being invalidate because project 7f182d19ea6145b2b942a4c06992726b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:12.889324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:12.890117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:12.894555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 912/1851] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:12 2022] DELETE /identity/v3/projects/7f182d19ea6145b2b942a4c06992726b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:12.896104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31446a5-e61e-4930-bb3c-423477747a5e service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:12.907287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31446a5-e61e-4930-bb3c-423477747a5e service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:12.995844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:12.998363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:12.998606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:12.998888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] PATH_INFO: `/v3/users/26d0fca360cd49dc80a8e2e24c3cedc9` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:13.000293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d0fca360cd49dc80a8e2e24c3cedc9)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:13.002267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:13.053580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d0fca360cd49dc80a8e2e24c3cedc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.054181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d0fca360cd49dc80a8e2e24c3cedc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.063299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d0fca360cd49dc80a8e2e24c3cedc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.073238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d0fca360cd49dc80a8e2e24c3cedc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.074048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-854ec235-b7e2-4024-a7a6-460d50de4018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d0fca360cd49dc80a8e2e24c3cedc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.092698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 940/1852] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:12 2022] DELETE /identity/v3/users/26d0fca360cd49dc80a8e2e24c3cedc9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:13.492799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:13.498387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:13.521390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16c0db-7ef2-4d78-867d-7e23a082e036 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:13.667937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:13.668838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:13.669125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:13.669399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] PATH_INFO: `/v3/projects/0fc7d197bac348a0b0b995615899e031` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:13.670666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fc7d197bac348a0b0b995615899e031)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:13.672647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:13.712580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:13.723228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fc7d197bac348a0b0b995615899e031', 'request_id': 'req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.731319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fc7d197bac348a0b0b995615899e031', 'request_id': 'req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.736990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fc7d197bac348a0b0b995615899e031', 'request_id': 'req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.747891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] The token cache is being invalidate because project 0fc7d197bac348a0b0b995615899e031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:13.748523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.748838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a0559a94-4339-4ad0-b5b5-2d64443dcfe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:13.750390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 913/1853] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:13 2022] DELETE /identity/v3/projects/0fc7d197bac348a0b0b995615899e031 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:13.755622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f611a-f43b-427e-a005-746a630e8c41 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:13.755935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f611a-f43b-427e-a005-746a630e8c41 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:13.756243 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f611a-f43b-427e-a005-746a630e8c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:13.774354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3c1f611a-f43b-427e-a005-746a630e8c41 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:13.775642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3c1f611a-f43b-427e-a005-746a630e8c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:13.839392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:13.847159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 941/1854] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:13.856255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9132f4-d4a8-4de9-8110-f7a15fcc39ef None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:13.856540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9132f4-d4a8-4de9-8110-f7a15fcc39ef None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:13.856814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9132f4-d4a8-4de9-8110-f7a15fcc39ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:13.875488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6f9132f4-d4a8-4de9-8110-f7a15fcc39ef None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:13.876720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6f9132f4-d4a8-4de9-8110-f7a15fcc39ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:13.885071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 914/1855] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:13.889392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f611a-f43b-427e-a005-746a630e8c41 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:13.900336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f611a-f43b-427e-a005-746a630e8c41 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:13.905776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:13.906610 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:13.906892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:13.907199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:13.907939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:13.908244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:13.910630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:13.928664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 942/1856] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:13.934432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9132f4-d4a8-4de9-8110-f7a15fcc39ef None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:13.944299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9132f4-d4a8-4de9-8110-f7a15fcc39ef None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:13.949044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1946c-1aee-4e80-84ec-c562d0012084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:13.949718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1946c-1aee-4e80-84ec-c562d0012084 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:13.950001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1946c-1aee-4e80-84ec-c562d0012084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:13.950278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1946c-1aee-4e80-84ec-c562d0012084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:13.950973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1946c-1aee-4e80-84ec-c562d0012084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:13.952907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1946c-1aee-4e80-84ec-c562d0012084 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:13.987727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 915/1857] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:13 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:13.991843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.013187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9014de9-209d-4a83-974d-32b9377c5cf1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.113173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c6cce-992d-4fc1-a5d6-220bd61c6d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.113898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6cce-992d-4fc1-a5d6-220bd61c6d20 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.114187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6cce-992d-4fc1-a5d6-220bd61c6d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.114465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c6cce-992d-4fc1-a5d6-220bd61c6d20 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.115321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c6cce-992d-4fc1-a5d6-220bd61c6d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.123196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c6cce-992d-4fc1-a5d6-220bd61c6d20 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.151712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 943/1858] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:13 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:14.152783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1946c-1aee-4e80-84ec-c562d0012084 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.165034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1946c-1aee-4e80-84ec-c562d0012084 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.171227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd29214-b320-4ef4-b6df-a6d3d0fbbf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.171963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29214-b320-4ef4-b6df-a6d3d0fbbf73 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.172252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29214-b320-4ef4-b6df-a6d3d0fbbf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.172735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd29214-b320-4ef4-b6df-a6d3d0fbbf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.173552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd29214-b320-4ef4-b6df-a6d3d0fbbf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.175180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd29214-b320-4ef4-b6df-a6d3d0fbbf73 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.206181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 916/1859] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:14.210637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c6cce-992d-4fc1-a5d6-220bd61c6d20 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.223873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c6cce-992d-4fc1-a5d6-220bd61c6d20 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.236678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3152ef-a14b-49fa-8467-36ae30e7f16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.237376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3152ef-a14b-49fa-8467-36ae30e7f16d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.237661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3152ef-a14b-49fa-8467-36ae30e7f16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.238032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3152ef-a14b-49fa-8467-36ae30e7f16d admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.238681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3152ef-a14b-49fa-8467-36ae30e7f16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.250129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3152ef-a14b-49fa-8467-36ae30e7f16d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.262014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 944/1860] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:14.266217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd29214-b320-4ef4-b6df-a6d3d0fbbf73 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.285017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd29214-b320-4ef4-b6df-a6d3d0fbbf73 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.291439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a47b5-f573-4e5c-a294-2e6a408a7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.292483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a47b5-f573-4e5c-a294-2e6a408a7d18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.292841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a47b5-f573-4e5c-a294-2e6a408a7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.293194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a47b5-f573-4e5c-a294-2e6a408a7d18 admin admin] PATH_INFO: `/v3/projects/506dd1d1c1ad4b8bad87dd60436d130f/users/7ad0930214844196981545ca2733740d/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.318892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a47b5-f573-4e5c-a294-2e6a408a7d18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=506dd1d1c1ad4b8bad87dd60436d130f, user_id=7ad0930214844196981545ca2733740d, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.322306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a47b5-f573-4e5c-a294-2e6a408a7d18 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.351218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 917/1861] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:14 2022] PUT /identity/v3/projects/506dd1d1c1ad4b8bad87dd60436d130f/users/7ad0930214844196981545ca2733740d/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:14.362281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b5ec-c3df-4b36-98ef-a86abc6c7845 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.362601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b5ec-c3df-4b36-98ef-a86abc6c7845 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.362851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b5ec-c3df-4b36-98ef-a86abc6c7845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.405910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-56d6b5ec-c3df-4b36-98ef-a86abc6c7845 None None] MFA Rules not processed for user `7ad0930214844196981545ca2733740d`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:14.408530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56d6b5ec-c3df-4b36-98ef-a86abc6c7845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:14.504776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 945/1862] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:14.509223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a47b5-f573-4e5c-a294-2e6a408a7d18 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.576315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a47b5-f573-4e5c-a294-2e6a408a7d18 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.583257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785081b5-84f3-49a5-8357-238a86c59238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.584505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785081b5-84f3-49a5-8357-238a86c59238 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.585346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785081b5-84f3-49a5-8357-238a86c59238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.585346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785081b5-84f3-49a5-8357-238a86c59238 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.586156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785081b5-84f3-49a5-8357-238a86c59238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.588929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785081b5-84f3-49a5-8357-238a86c59238 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.631483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 918/1863] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:14 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:14.633101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b5ec-c3df-4b36-98ef-a86abc6c7845 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.645239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b5ec-c3df-4b36-98ef-a86abc6c7845 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.713798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:14.722721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb4600-ac3e-4b98-acd8-cc7352aa9ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.723462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb4600-ac3e-4b98-acd8-cc7352aa9ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.723800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb4600-ac3e-4b98-acd8-cc7352aa9ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.724076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eb4600-ac3e-4b98-acd8-cc7352aa9ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.724801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb4600-ac3e-4b98-acd8-cc7352aa9ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.726693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eb4600-ac3e-4b98-acd8-cc7352aa9ac8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.752227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 946/1864] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:14 2022] POST /identity/v3/users => generated 297 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:14.756302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785081b5-84f3-49a5-8357-238a86c59238 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.768492 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785081b5-84f3-49a5-8357-238a86c59238 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.774108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae164f8-8e72-43d2-aa8b-ce9304564d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.775043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae164f8-8e72-43d2-aa8b-ce9304564d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.775586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae164f8-8e72-43d2-aa8b-ce9304564d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.776346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae164f8-8e72-43d2-aa8b-ce9304564d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.777478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae164f8-8e72-43d2-aa8b-ce9304564d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.779252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae164f8-8e72-43d2-aa8b-ce9304564d18 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.796219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 919/1865] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:14.797008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb4600-ac3e-4b98-acd8-cc7352aa9ac8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.808884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eb4600-ac3e-4b98-acd8-cc7352aa9ac8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.813892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b6507-49c6-4ff2-bc10-fec3a6867863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.815116 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b6507-49c6-4ff2-bc10-fec3a6867863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.815463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b6507-49c6-4ff2-bc10-fec3a6867863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.815776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0b6507-49c6-4ff2-bc10-fec3a6867863 admin admin] PATH_INFO: `/v3/projects/b30403fbb3aa4be2acdf5b4ef8cc79a7/users/792cd2d4b8ed43958ba373a91e6bd77b/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.831954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b6507-49c6-4ff2-bc10-fec3a6867863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30403fbb3aa4be2acdf5b4ef8cc79a7, user_id=792cd2d4b8ed43958ba373a91e6bd77b, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.834606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0b6507-49c6-4ff2-bc10-fec3a6867863 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.850283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 947/1866] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:14 2022] PUT /identity/v3/projects/b30403fbb3aa4be2acdf5b4ef8cc79a7/users/792cd2d4b8ed43958ba373a91e6bd77b/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:14.854140 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae164f8-8e72-43d2-aa8b-ce9304564d18 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.864901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae164f8-8e72-43d2-aa8b-ce9304564d18 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.901094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:14.927910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87940332-cf90-4c32-8476-d29b05c73a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.928593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940332-cf90-4c32-8476-d29b05c73a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.928867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940332-cf90-4c32-8476-d29b05c73a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.929184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87940332-cf90-4c32-8476-d29b05c73a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.929994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87940332-cf90-4c32-8476-d29b05c73a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.931866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87940332-cf90-4c32-8476-d29b05c73a33 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.942597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 920/1867] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:14.946998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b6507-49c6-4ff2-bc10-fec3a6867863 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:14.958004 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0b6507-49c6-4ff2-bc10-fec3a6867863 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:14.963392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:14.964367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.964655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.964935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] PATH_INFO: `/v3/projects/b30403fbb3aa4be2acdf5b4ef8cc79a7/users/792cd2d4b8ed43958ba373a91e6bd77b/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:14.967136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b30403fbb3aa4be2acdf5b4ef8cc79a7, user_id=792cd2d4b8ed43958ba373a91e6bd77b, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:14.969834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:14.980747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 948/1868] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:14 2022] PUT /identity/v3/projects/b30403fbb3aa4be2acdf5b4ef8cc79a7/users/792cd2d4b8ed43958ba373a91e6bd77b/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:14.992077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076be5af-4a32-44ca-b1db-6b98c7f5ac6e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:14.992366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076be5af-4a32-44ca-b1db-6b98c7f5ac6e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:14.992646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076be5af-4a32-44ca-b1db-6b98c7f5ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:15.020002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-076be5af-4a32-44ca-b1db-6b98c7f5ac6e None None] MFA Rules not processed for user `792cd2d4b8ed43958ba373a91e6bd77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:15.021222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-076be5af-4a32-44ca-b1db-6b98c7f5ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:15.097392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 921/1869] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:15.110271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:15.112010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:15.173344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6a3c9-2943-4879-9c3c-7a5b78f0701f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:15.177145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c9644-083d-44c7-91c1-01dedb38252e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:15.177832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c9644-083d-44c7-91c1-01dedb38252e service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:15.178154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c9644-083d-44c7-91c1-01dedb38252e service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:15.178390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c9644-083d-44c7-91c1-01dedb38252e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:15.189351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c9644-083d-44c7-91c1-01dedb38252e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:15.191095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c9644-083d-44c7-91c1-01dedb38252e service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:15.200814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 949/1870] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:42:15.287535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076be5af-4a32-44ca-b1db-6b98c7f5ac6e None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:15.297475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076be5af-4a32-44ca-b1db-6b98c7f5ac6e None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:15.301403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:15.302141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:15.303060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:15.303352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:15.365959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:15.367425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:15.381909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 922/1871] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:15.671547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c9644-083d-44c7-91c1-01dedb38252e service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:15.741833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c9644-083d-44c7-91c1-01dedb38252e service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:15.748475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:15.748475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:15.749068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:15.749366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] PATH_INFO: `/v3/users/7ad0930214844196981545ca2733740d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:15.750740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad0930214844196981545ca2733740d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:15.752918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:15.817286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad0930214844196981545ca2733740d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.817981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad0930214844196981545ca2733740d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.822489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:15.827017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad0930214844196981545ca2733740d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.841322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:15.843369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:15.844650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad0930214844196981545ca2733740d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.845380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f86a8286-bea4-4bae-ad5d-7f2e9e947143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad0930214844196981545ca2733740d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.862980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f80f7-80fd-45fe-b0fc-9115fe01ea08 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:15.868176 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:15.869187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:15.869571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:15.869893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] PATH_INFO: `/v3/users/4be2d87b3e3c420cbcc454fa1a6f1b78` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:15.870007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 950/1872] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:15 2022] DELETE /identity/v3/users/7ad0930214844196981545ca2733740d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:15.871244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be2d87b3e3c420cbcc454fa1a6f1b78)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:15.873085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:15.874264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef915d4-27e0-410a-8643-1259acd5b070 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:15.874549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef915d4-27e0-410a-8643-1259acd5b070 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:15.874832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef915d4-27e0-410a-8643-1259acd5b070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:15.901934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3ef915d4-27e0-410a-8643-1259acd5b070 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:15.903733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3ef915d4-27e0-410a-8643-1259acd5b070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:15.937811 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be2d87b3e3c420cbcc454fa1a6f1b78'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.941752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:15.951543 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be2d87b3e3c420cbcc454fa1a6f1b78'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.953232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be2d87b3e3c420cbcc454fa1a6f1b78'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.964692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be2d87b3e3c420cbcc454fa1a6f1b78'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.981718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f1e537da-6c4d-474b-b274-42e2d3fcc0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be2d87b3e3c420cbcc454fa1a6f1b78'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:15.989429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 923/1873] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:15 2022] DELETE /identity/v3/users/4be2d87b3e3c420cbcc454fa1a6f1b78 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:15.990266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 951/1874] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:16.001092 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2609ff-cd20-4764-941d-b5f648473cb1 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:16.001467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2609ff-cd20-4764-941d-b5f648473cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:16.001598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef915d4-27e0-410a-8643-1259acd5b070 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:16.002530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2609ff-cd20-4764-941d-b5f648473cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:16.003555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3ef915d4-27e0-410a-8643-1259acd5b070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:16.027488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1c2609ff-cd20-4764-941d-b5f648473cb1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:16.029762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1c2609ff-cd20-4764-941d-b5f648473cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:16.078189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef915d4-27e0-410a-8643-1259acd5b070 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:16.103811 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 924/1875] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:16.113259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2609ff-cd20-4764-941d-b5f648473cb1 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:16.127292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:16.128480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:16.128600 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:16.128950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:16.139331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:16.140873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:16.151691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 952/1876] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:42:16.177883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2609ff-cd20-4764-941d-b5f648473cb1 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:16.181822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:16.182525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:16.182809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:16.183085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:16.194193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:16.195678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:16.207169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 925/1877] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:42:16.539293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:16.541763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:16.568725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e429c3-3282-44b0-9ff6-a2abf81cc140 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:16.576789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:16.578232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:16.579122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:16.579423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] PATH_INFO: `/v3/projects/506dd1d1c1ad4b8bad87dd60436d130f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:16.584981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=506dd1d1c1ad4b8bad87dd60436d130f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:16.587112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:16.623501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:16.623720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:16.625655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:16.645303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe964e-9005-4757-b694-d8653e3d9d9c service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:16.698201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '506dd1d1c1ad4b8bad87dd60436d130f', 'request_id': 'req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.710344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '506dd1d1c1ad4b8bad87dd60436d130f', 'request_id': 'req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.721100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:16.722338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:16.722722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:16.723188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] PATH_INFO: `/v3/projects/d41b96e014e14649b0f836fed52d2b2b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:16.724742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41b96e014e14649b0f836fed52d2b2b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:16.726553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '506dd1d1c1ad4b8bad87dd60436d130f', 'request_id': 'req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.726985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:16.739955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:16.743058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] The token cache is being invalidate because project 506dd1d1c1ad4b8bad87dd60436d130f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:16.743545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.744532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.746425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 953/1878] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:16 2022] DELETE /identity/v3/projects/506dd1d1c1ad4b8bad87dd60436d130f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:16.750467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:16.751906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:16.768023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec75b5-0f71-4697-8d3e-086a3ed25d18 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:16.774881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:16.775873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:16.776149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:16.776428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] PATH_INFO: `/v3/users/792cd2d4b8ed43958ba373a91e6bd77b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:16.777683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=792cd2d4b8ed43958ba373a91e6bd77b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:16.779894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:16.787306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41b96e014e14649b0f836fed52d2b2b', 'request_id': 'req-0ee77254-6bfc-4209-89df-ef6bdf336461'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.798755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41b96e014e14649b0f836fed52d2b2b', 'request_id': 'req-0ee77254-6bfc-4209-89df-ef6bdf336461'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.808834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41b96e014e14649b0f836fed52d2b2b', 'request_id': 'req-0ee77254-6bfc-4209-89df-ef6bdf336461'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.828446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] The token cache is being invalidate because project d41b96e014e14649b0f836fed52d2b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:16.829695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.830880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.836581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 926/1879] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:16 2022] DELETE /identity/v3/projects/d41b96e014e14649b0f836fed52d2b2b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:16.837814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:16.839573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:16.867798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792cd2d4b8ed43958ba373a91e6bd77b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.868566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792cd2d4b8ed43958ba373a91e6bd77b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.884841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792cd2d4b8ed43958ba373a91e6bd77b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.904171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792cd2d4b8ed43958ba373a91e6bd77b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.905081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792cd2d4b8ed43958ba373a91e6bd77b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:16.920916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee77254-6bfc-4209-89df-ef6bdf336461 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:16.927578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:16.928500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:16.928782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:16.929108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] PATH_INFO: `/v3/users/67cae36f8760404285e7048d81455130` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:16.930546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67cae36f8760404285e7048d81455130)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:16.932408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:16.945443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 954/1880] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:16 2022] DELETE /identity/v3/users/792cd2d4b8ed43958ba373a91e6bd77b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:17.010934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67cae36f8760404285e7048d81455130'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.022520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67cae36f8760404285e7048d81455130'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.023548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67cae36f8760404285e7048d81455130'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.035027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67cae36f8760404285e7048d81455130'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.055817 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67cae36f8760404285e7048d81455130'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.066498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 927/1881] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:16 2022] DELETE /identity/v3/users/67cae36f8760404285e7048d81455130 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:17.344762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:17.347043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.439115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:17.441384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.476561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:17.493112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3428e431-548e-4cc4-8514-11c069d32916 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:17.534935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:17.550603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2446afb-740f-452c-9765-9459e5b40405 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:17.559484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:17.560568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.560860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.561428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] PATH_INFO: `/v3/projects/b30403fbb3aa4be2acdf5b4ef8cc79a7` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.563328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b30403fbb3aa4be2acdf5b4ef8cc79a7)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:17.565704 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:17.575882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:17.577033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.577479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.577775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] PATH_INFO: `/v3/users/7e6f14a6cbd7488eabc7a37df344642c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.580564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6f14a6cbd7488eabc7a37df344642c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:17.582712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:17.660756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b30403fbb3aa4be2acdf5b4ef8cc79a7', 'request_id': 'req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.673261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b30403fbb3aa4be2acdf5b4ef8cc79a7', 'request_id': 'req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.674519 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6f14a6cbd7488eabc7a37df344642c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.675785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6f14a6cbd7488eabc7a37df344642c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.680185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b30403fbb3aa4be2acdf5b4ef8cc79a7', 'request_id': 'req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.691671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6f14a6cbd7488eabc7a37df344642c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.696524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] The token cache is being invalidate because project b30403fbb3aa4be2acdf5b4ef8cc79a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:17.696797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.697575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ce9dc378-bd08-4f0d-9ae2-bbbd110eff5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.699564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 928/1882] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:17 2022] DELETE /identity/v3/projects/b30403fbb3aa4be2acdf5b4ef8cc79a7 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:17.705369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf68b6-2601-4289-9d91-feadcb0b66c4 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.705656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf68b6-2601-4289-9d91-feadcb0b66c4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.705948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccf68b6-2601-4289-9d91-feadcb0b66c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.707556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6f14a6cbd7488eabc7a37df344642c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.710646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6f14a6cbd7488eabc7a37df344642c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.736027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6ccf68b6-2601-4289-9d91-feadcb0b66c4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:17.737381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6ccf68b6-2601-4289-9d91-feadcb0b66c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.739320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 955/1883] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:17 2022] DELETE /identity/v3/users/7e6f14a6cbd7488eabc7a37df344642c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:17.740188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:17.742066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.812141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7b3f8-6f2a-4bd0-96c2-df63dee5d9fa admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:17.817014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:17.817166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 929/1884] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:17.818431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39e43-443b-4083-a1e9-636efbf49580 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.818805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39e43-443b-4083-a1e9-636efbf49580 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.819136 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e39e43-443b-4083-a1e9-636efbf49580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.824224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.824524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.824795 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] PATH_INFO: `/v3/projects/a34160ea5096414b969a400bf3b47ce7` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.826071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=a34160ea5096414b969a400bf3b47ce7)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:17.828052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:17.836380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-38e39e43-443b-4083-a1e9-636efbf49580 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:17.837631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-38e39e43-443b-4083-a1e9-636efbf49580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.845528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 930/1885] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:17.849166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d8ea-4ba2-4d43-81d6-b4d852cedbdb None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.849166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d8ea-4ba2-4d43-81d6-b4d852cedbdb None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.849166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d694d8ea-4ba2-4d43-81d6-b4d852cedbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.865890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d694d8ea-4ba2-4d43-81d6-b4d852cedbdb None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:17.867213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d694d8ea-4ba2-4d43-81d6-b4d852cedbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.879545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a34160ea5096414b969a400bf3b47ce7', 'request_id': 'req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.882072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:17.886977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a34160ea5096414b969a400bf3b47ce7', 'request_id': 'req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.895914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a34160ea5096414b969a400bf3b47ce7', 'request_id': 'req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.907127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] The token cache is being invalidate because project a34160ea5096414b969a400bf3b47ce7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:17.907465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.908222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:17.910070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:17.911678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 956/1886] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:17 2022] DELETE /identity/v3/projects/a34160ea5096414b969a400bf3b47ce7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:17.912682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:17.914459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.931260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 931/1887] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:17.932726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bfba-dab1-4bad-a844-13d5689a3ac4 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.933023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bfba-dab1-4bad-a844-13d5689a3ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.933322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bfba-dab1-4bad-a844-13d5689a3ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.951346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-afd1bfba-dab1-4bad-a844-13d5689a3ac4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:17.952628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-afd1bfba-dab1-4bad-a844-13d5689a3ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.960586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 932/1888] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:17.961357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1bfba-dab1-4bad-a844-13d5689a3ac4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:17.970628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1bfba-dab1-4bad-a844-13d5689a3ac4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:17.975303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68045560-6f72-4163-9e3a-3f7c5e183aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:17.976001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045560-6f72-4163-9e3a-3f7c5e183aae admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.976100 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8af82b-199d-483d-9669-0b0ccaf9e5ea admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:17.976288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045560-6f72-4163-9e3a-3f7c5e183aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.976564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045560-6f72-4163-9e3a-3f7c5e183aae admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.977332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045560-6f72-4163-9e3a-3f7c5e183aae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:17.977641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045560-6f72-4163-9e3a-3f7c5e183aae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:17.979360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045560-6f72-4163-9e3a-3f7c5e183aae admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:17.979874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:17.980583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.980948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.981129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.982903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:17.991791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 933/1889] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:17.993062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f672b-5a91-4cab-818d-2c8d8c1102be None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:17.993379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f672b-5a91-4cab-818d-2c8d8c1102be None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:17.993655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f672b-5a91-4cab-818d-2c8d8c1102be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:17.997786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:17.999700 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.010113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 957/1890] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:18.011051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.013576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-731f672b-5a91-4cab-818d-2c8d8c1102be None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:18.014789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-731f672b-5a91-4cab-818d-2c8d8c1102be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:18.021139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a87ea-a8b1-4f46-96aa-6aa842089c5e service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.026826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab54e91-b769-4397-8d7b-73c79bf66c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.027638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54e91-b769-4397-8d7b-73c79bf66c41 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.027932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54e91-b769-4397-8d7b-73c79bf66c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.028211 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab54e91-b769-4397-8d7b-73c79bf66c41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.029076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54e91-b769-4397-8d7b-73c79bf66c41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.031001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab54e91-b769-4397-8d7b-73c79bf66c41 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.031733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 934/1891] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:18.036304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f672b-5a91-4cab-818d-2c8d8c1102be None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.061808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f672b-5a91-4cab-818d-2c8d8c1102be None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.070931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.072158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.072684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.073226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.074239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:18.074929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.077489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.081910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 958/1892] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:18 2022] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:18.087454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab54e91-b769-4397-8d7b-73c79bf66c41 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.108413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 935/1893] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:18.110772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.124650 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50e7dd-b587-4ebe-aa0a-744563ccede7 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.220516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9713de8-cc1d-4486-8804-32c65ff2d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.222093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab54e91-b769-4397-8d7b-73c79bf66c41 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.223400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713de8-cc1d-4486-8804-32c65ff2d451 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.224099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713de8-cc1d-4486-8804-32c65ff2d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.225495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9713de8-cc1d-4486-8804-32c65ff2d451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.227037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9713de8-cc1d-4486-8804-32c65ff2d451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.227729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb7b1b-e09b-4a32-be78-973c3cf2d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.229076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7b1b-e09b-4a32-be78-973c3cf2d665 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.229497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7b1b-e09b-4a32-be78-973c3cf2d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.229845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb7b1b-e09b-4a32-be78-973c3cf2d665 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.230686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9713de8-cc1d-4486-8804-32c65ff2d451 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.230827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb7b1b-e09b-4a32-be78-973c3cf2d665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.232956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb7b1b-e09b-4a32-be78-973c3cf2d665 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.262726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 959/1894] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:18 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:18.265761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 936/1895] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:18 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:18.268504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb7b1b-e09b-4a32-be78-973c3cf2d665 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.269807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9713de8-cc1d-4486-8804-32c65ff2d451 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.287198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb7b1b-e09b-4a32-be78-973c3cf2d665 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.368733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:18.369392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9713de8-cc1d-4486-8804-32c65ff2d451 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.375964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15f85d-5b65-4bf0-ade0-a63a46954058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.376818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f85d-5b65-4bf0-ade0-a63a46954058 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.377111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f85d-5b65-4bf0-ade0-a63a46954058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.377391 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15f85d-5b65-4bf0-ade0-a63a46954058 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.378432 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15f85d-5b65-4bf0-ade0-a63a46954058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.380693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15f85d-5b65-4bf0-ade0-a63a46954058 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.385472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.386162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.386448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.386721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.387462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.389098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.406899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 960/1896] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:18.407873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.408466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 937/1897] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:18 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:18.411313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15f85d-5b65-4bf0-ade0-a63a46954058 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.412680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:18.424390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15f85d-5b65-4bf0-ade0-a63a46954058 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.427157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f1375a-e578-4f82-a529-3764838080eb admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.431102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4d0de-bcc4-4bae-9455-a1a875570c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.432261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4d0de-bcc4-4bae-9455-a1a875570c12 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.432603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4d0de-bcc4-4bae-9455-a1a875570c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.432885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4d0de-bcc4-4bae-9455-a1a875570c12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.433667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4d0de-bcc4-4bae-9455-a1a875570c12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.434366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.435386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.435501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4d0de-bcc4-4bae-9455-a1a875570c12 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.435578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.435988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] PATH_INFO: `/v3/projects/3dec950729694a85acbdd2614c24479c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.438641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dec950729694a85acbdd2614c24479c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.440686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.454345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 938/1898] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:18.456623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4d0de-bcc4-4bae-9455-a1a875570c12 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.469729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4d0de-bcc4-4bae-9455-a1a875570c12 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.476895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c1b68-cc6c-4529-b65f-ec09c114196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.477723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c1b68-cc6c-4529-b65f-ec09c114196c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.478232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c1b68-cc6c-4529-b65f-ec09c114196c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.478600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c1b68-cc6c-4529-b65f-ec09c114196c admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.479582 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c1b68-cc6c-4529-b65f-ec09c114196c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.481372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c1b68-cc6c-4529-b65f-ec09c114196c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.484793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:18.500195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 939/1899] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:18.501892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c1b68-cc6c-4529-b65f-ec09c114196c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.511291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dec950729694a85acbdd2614c24479c', 'request_id': 'req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.514562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c1b68-cc6c-4529-b65f-ec09c114196c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.523885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dec950729694a85acbdd2614c24479c', 'request_id': 'req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.542405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dec950729694a85acbdd2614c24479c', 'request_id': 'req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.554367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] The token cache is being invalidate because project 3dec950729694a85acbdd2614c24479c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:18.554730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.555394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.557148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 961/1900] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:18 2022] DELETE /identity/v3/projects/3dec950729694a85acbdd2614c24479c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:18.557906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.559367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:18.578906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.579877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.580161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.580459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] PATH_INFO: `/v3/projects/c16e9de9af264550a8fba1e0d00577cd/users/e885bb7e601e4ef49a06cfe1170150d5/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.595703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16e9de9af264550a8fba1e0d00577cd, user_id=e885bb7e601e4ef49a06cfe1170150d5, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.598360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.614142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 940/1901] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:18 2022] PUT /identity/v3/projects/c16e9de9af264550a8fba1e0d00577cd/users/e885bb7e601e4ef49a06cfe1170150d5/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:18.622945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.622945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:18.628111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c461c85-2bce-4a1b-a06e-22cc495dbfe9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.686552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9968fe-5c84-4257-a2d5-357b10e36ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.687240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9968fe-5c84-4257-a2d5-357b10e36ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.687583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9968fe-5c84-4257-a2d5-357b10e36ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.687832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9968fe-5c84-4257-a2d5-357b10e36ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.688577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9968fe-5c84-4257-a2d5-357b10e36ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.689555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60562550-5e6c-432e-adb9-5ba10c42012e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.690553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9968fe-5c84-4257-a2d5-357b10e36ef1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.694903 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.695843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.696388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.696388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] PATH_INFO: `/v3/users/2cdb01f5f277413f8f22c9dda9edfea9` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.697619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cdb01f5f277413f8f22c9dda9edfea9)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.699557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.701490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 962/1902] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:18 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:18.702788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d508b5-15d3-41af-83e3-a7bab5b8201f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.703079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d508b5-15d3-41af-83e3-a7bab5b8201f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.703358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d508b5-15d3-41af-83e3-a7bab5b8201f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.733787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:18.737205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-47d508b5-15d3-41af-83e3-a7bab5b8201f None None] MFA Rules not processed for user `e885bb7e601e4ef49a06cfe1170150d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:18.739741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-47d508b5-15d3-41af-83e3-a7bab5b8201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:18.756419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cdb01f5f277413f8f22c9dda9edfea9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.765257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cdb01f5f277413f8f22c9dda9edfea9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.766381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cdb01f5f277413f8f22c9dda9edfea9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.775492 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cdb01f5f277413f8f22c9dda9edfea9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.790791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cdb01f5f277413f8f22c9dda9edfea9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:18.795525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:18.805031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 941/1903] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:18 2022] DELETE /identity/v3/users/2cdb01f5f277413f8f22c9dda9edfea9 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:18.808765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.811418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:18.842666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 963/1904] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:18.854643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d508b5-15d3-41af-83e3-a7bab5b8201f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:18.856394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-47d508b5-15d3-41af-83e3-a7bab5b8201f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:18.906277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad4497f-efe5-48bb-a23e-b673f03c859b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.911583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e88aa9-07f4-42b8-b2ed-db5c262aebd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:18.912238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e88aa9-07f4-42b8-b2ed-db5c262aebd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.912557 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e88aa9-07f4-42b8-b2ed-db5c262aebd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.912810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e88aa9-07f4-42b8-b2ed-db5c262aebd1 admin admin] PATH_INFO: `/v3/projects/536d0cf3e9f044a8a988256776909ee0/users/f3a7a8ebfb1e43a2a7d48cf1a5fbccdd/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:18.925921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d508b5-15d3-41af-83e3-a7bab5b8201f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:18.942659 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e88aa9-07f4-42b8-b2ed-db5c262aebd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536d0cf3e9f044a8a988256776909ee0, user_id=f3a7a8ebfb1e43a2a7d48cf1a5fbccdd, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:18.945563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e88aa9-07f4-42b8-b2ed-db5c262aebd1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:18.967830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 942/1905] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:18 2022] PUT /identity/v3/projects/536d0cf3e9f044a8a988256776909ee0/users/f3a7a8ebfb1e43a2a7d48cf1a5fbccdd/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:18.978737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e710e-ed6d-4d89-80ae-807987270654 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:18.979293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e710e-ed6d-4d89-80ae-807987270654 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:18.979854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e710e-ed6d-4d89-80ae-807987270654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.013219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-782e710e-ed6d-4d89-80ae-807987270654 None None] MFA Rules not processed for user `f3a7a8ebfb1e43a2a7d48cf1a5fbccdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:19.014743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-782e710e-ed6d-4d89-80ae-807987270654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:19.036771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:19.038135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:19.038552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:19.038895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.109156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 943/1906] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:19.122452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e710e-ed6d-4d89-80ae-807987270654 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:19.123940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-782e710e-ed6d-4d89-80ae-807987270654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:19.127998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:19.129627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:19.141332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 964/1907] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:42:19.257247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e710e-ed6d-4d89-80ae-807987270654 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:19.263461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300384a-7b07-468d-990e-bed9b4c02308 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:19.264227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300384a-7b07-468d-990e-bed9b4c02308 service glance] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:19.264859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300384a-7b07-468d-990e-bed9b4c02308 service glance] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:19.265110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300384a-7b07-468d-990e-bed9b4c02308 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.273351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:19.278489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300384a-7b07-468d-990e-bed9b4c02308 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:19.280694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300384a-7b07-468d-990e-bed9b4c02308 service glance] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:19.294096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 944/1908] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:42:19.344565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:19.346251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:19.379369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6716d86-4923-40bc-8fac-a5dae6b49a35 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:19.403688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:19.470317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:19.471414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:19.471913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:19.480109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] PATH_INFO: `/v3/projects/8131d3651de2480692fe702f11c0a544` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.482577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8131d3651de2480692fe702f11c0a544)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:19.485171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:19.564257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8131d3651de2480692fe702f11c0a544', 'request_id': 'req-853c7365-93f1-43de-a069-1ea31080d030'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:19.607307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8131d3651de2480692fe702f11c0a544', 'request_id': 'req-853c7365-93f1-43de-a069-1ea31080d030'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:19.636447 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8131d3651de2480692fe702f11c0a544', 'request_id': 'req-853c7365-93f1-43de-a069-1ea31080d030'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:19.661963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] The token cache is being invalidate because project 8131d3651de2480692fe702f11c0a544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:19.662490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:19.663434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-853c7365-93f1-43de-a069-1ea31080d030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:19.668224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 965/1909] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:19 2022] DELETE /identity/v3/projects/8131d3651de2480692fe702f11c0a544 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:19.673221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb446-aa0a-49f9-9e08-0b0356c80c79 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:19.673519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb446-aa0a-49f9-9e08-0b0356c80c79 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:19.673798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bb446-aa0a-49f9-9e08-0b0356c80c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.706178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b45bb446-aa0a-49f9-9e08-0b0356c80c79 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:19.707412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b45bb446-aa0a-49f9-9e08-0b0356c80c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:19.839139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 945/1910] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:19.847724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288ed69-317a-4bf9-8cf5-f938126afca1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:19.848229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288ed69-317a-4bf9-8cf5-f938126afca1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:19.848690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288ed69-317a-4bf9-8cf5-f938126afca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.873596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c288ed69-317a-4bf9-8cf5-f938126afca1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:19.876349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ba00f-ff4a-4298-b4a8-b46d5d20ca91 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:19.876640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ba00f-ff4a-4298-b4a8-b46d5d20ca91 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:19.876923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ba00f-ff4a-4298-b4a8-b46d5d20ca91 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.878291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 946/1911] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:42:19.879594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c288ed69-317a-4bf9-8cf5-f938126afca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:19.897704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 966/1912] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:19.899375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065075-865a-46fe-8218-8c27e796eecf None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:19.899694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065075-865a-46fe-8218-8c27e796eecf None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:19.899989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22065075-865a-46fe-8218-8c27e796eecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.904155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288ed69-317a-4bf9-8cf5-f938126afca1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:19.926694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c288ed69-317a-4bf9-8cf5-f938126afca1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:19.936854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:19.938620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:19.940743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-22065075-865a-46fe-8218-8c27e796eecf None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:19.941455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:19.941455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:19.942300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:19.943234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-22065075-865a-46fe-8218-8c27e796eecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:19.944026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:19.947049 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.006687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 967/1913] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:20.008655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.021806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410cf7cb-0be7-489c-bb37-2f53dca98a28 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.026701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bde6da-35e4-4a84-a5d2-606ae3b07662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.027745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde6da-35e4-4a84-a5d2-606ae3b07662 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.028099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde6da-35e4-4a84-a5d2-606ae3b07662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.028589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bde6da-35e4-4a84-a5d2-606ae3b07662 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.029425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bde6da-35e4-4a84-a5d2-606ae3b07662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.032086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bde6da-35e4-4a84-a5d2-606ae3b07662 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.084205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 968/1914] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:20 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:20.092679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bde6da-35e4-4a84-a5d2-606ae3b07662 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.094485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 947/1915] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:42:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:20.116110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22065075-865a-46fe-8218-8c27e796eecf None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.117470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-22065075-865a-46fe-8218-8c27e796eecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:20.136417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22065075-865a-46fe-8218-8c27e796eecf None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.185283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bde6da-35e4-4a84-a5d2-606ae3b07662 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.190789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392972-c884-4127-88e1-175655e0a8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.191502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392972-c884-4127-88e1-175655e0a8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.191823 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392972-c884-4127-88e1-175655e0a8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.192104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be392972-c884-4127-88e1-175655e0a8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.192810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be392972-c884-4127-88e1-175655e0a8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.194788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be392972-c884-4127-88e1-175655e0a8b0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.202847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:20.218263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46ee0-85b1-4015-9d04-00ec79ac2db6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.218941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46ee0-85b1-4015-9d04-00ec79ac2db6 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.219301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46ee0-85b1-4015-9d04-00ec79ac2db6 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.219494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c46ee0-85b1-4015-9d04-00ec79ac2db6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.221277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 969/1916] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:20 2022] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:20.225097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392972-c884-4127-88e1-175655e0a8b0 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.230098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c46ee0-85b1-4015-9d04-00ec79ac2db6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.232376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c46ee0-85b1-4015-9d04-00ec79ac2db6 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.235927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be392972-c884-4127-88e1-175655e0a8b0 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.243290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250e717-4d47-45b9-98b2-acba7b5cce46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.243458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 948/1917] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:20.244097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250e717-4d47-45b9-98b2-acba7b5cce46 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.244431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250e717-4d47-45b9-98b2-acba7b5cce46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.244714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9250e717-4d47-45b9-98b2-acba7b5cce46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.245537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250e717-4d47-45b9-98b2-acba7b5cce46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.247483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9250e717-4d47-45b9-98b2-acba7b5cce46 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.259759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 970/1918] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:20.262956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46ee0-85b1-4015-9d04-00ec79ac2db6 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.274160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c46ee0-85b1-4015-9d04-00ec79ac2db6 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.280788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057881b3-1a2b-4c64-8fcb-14eff1357d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.281363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057881b3-1a2b-4c64-8fcb-14eff1357d06 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.281621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057881b3-1a2b-4c64-8fcb-14eff1357d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.281902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057881b3-1a2b-4c64-8fcb-14eff1357d06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.282636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057881b3-1a2b-4c64-8fcb-14eff1357d06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.284351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057881b3-1a2b-4c64-8fcb-14eff1357d06 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.295145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 949/1919] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:20.299155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250e717-4d47-45b9-98b2-acba7b5cce46 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.310652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9250e717-4d47-45b9-98b2-acba7b5cce46 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.317522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02712-a1ee-456a-bf67-34567e3ba9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.318704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02712-a1ee-456a-bf67-34567e3ba9fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.319008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02712-a1ee-456a-bf67-34567e3ba9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.319294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b02712-a1ee-456a-bf67-34567e3ba9fb admin admin] PATH_INFO: `/v3/projects/3cbcecfbead24ad6ba4835f07e4a4f49/users/f07a638061104303846c943771eca082/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.336140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02712-a1ee-456a-bf67-34567e3ba9fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cbcecfbead24ad6ba4835f07e4a4f49, user_id=f07a638061104303846c943771eca082, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.338829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b02712-a1ee-456a-bf67-34567e3ba9fb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.352769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 971/1920] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:20 2022] PUT /identity/v3/projects/3cbcecfbead24ad6ba4835f07e4a4f49/users/f07a638061104303846c943771eca082/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:20.364174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8191-5ed3-4cee-852a-733bc7fe4171 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.364587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8191-5ed3-4cee-852a-733bc7fe4171 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.364947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c8191-5ed3-4cee-852a-733bc7fe4171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.370938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:20.394886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-805c8191-5ed3-4cee-852a-733bc7fe4171 None None] MFA Rules not processed for user `f07a638061104303846c943771eca082`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:20.396244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-805c8191-5ed3-4cee-852a-733bc7fe4171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:20.468235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 950/1921] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:20.472921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02712-a1ee-456a-bf67-34567e3ba9fb admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.541494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b02712-a1ee-456a-bf67-34567e3ba9fb admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.546725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2bfee-2bfa-424b-81df-db5b34fd3e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.547406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2bfee-2bfa-424b-81df-db5b34fd3e19 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.547718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2bfee-2bfa-424b-81df-db5b34fd3e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.547996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2bfee-2bfa-424b-81df-db5b34fd3e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.548751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2bfee-2bfa-424b-81df-db5b34fd3e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.550659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2bfee-2bfa-424b-81df-db5b34fd3e19 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.580267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 972/1922] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:20 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:20.584783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c8191-5ed3-4cee-852a-733bc7fe4171 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.597415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c8191-5ed3-4cee-852a-733bc7fe4171 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.672749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d30ec8-c7f3-4480-a5c0-cb6dcef58612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.673500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d30ec8-c7f3-4480-a5c0-cb6dcef58612 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.673784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d30ec8-c7f3-4480-a5c0-cb6dcef58612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.674110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d30ec8-c7f3-4480-a5c0-cb6dcef58612 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.674783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d30ec8-c7f3-4480-a5c0-cb6dcef58612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.676814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d30ec8-c7f3-4480-a5c0-cb6dcef58612 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.705765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 951/1923] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:20 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:20.707033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2bfee-2bfa-424b-81df-db5b34fd3e19 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.718395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2bfee-2bfa-424b-81df-db5b34fd3e19 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.723709 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ccf88-a256-4f28-9404-9304a324e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.724397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccf88-a256-4f28-9404-9304a324e558 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.724682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccf88-a256-4f28-9404-9304a324e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.724965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ccf88-a256-4f28-9404-9304a324e558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.725692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ccf88-a256-4f28-9404-9304a324e558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.727270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ccf88-a256-4f28-9404-9304a324e558 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.739346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 973/1924] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:20.743276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d30ec8-c7f3-4480-a5c0-cb6dcef58612 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.758371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d30ec8-c7f3-4480-a5c0-cb6dcef58612 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.766971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b7871-eb59-4cc0-b346-58289d06a9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.767769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7871-eb59-4cc0-b346-58289d06a9a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.768115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7871-eb59-4cc0-b346-58289d06a9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.768460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b7871-eb59-4cc0-b346-58289d06a9a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.769262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b7871-eb59-4cc0-b346-58289d06a9a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.770930 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969b7871-eb59-4cc0-b346-58289d06a9a6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.782347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 952/1925] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:20.785466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31305-76a9-45da-84d6-7649d6c169f2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.785824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31305-76a9-45da-84d6-7649d6c169f2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.786087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b7871-eb59-4cc0-b346-58289d06a9a6 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.786231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa31305-76a9-45da-84d6-7649d6c169f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.799824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969b7871-eb59-4cc0-b346-58289d06a9a6 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:20.805919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de9d61-bf55-4e99-8e24-389ccc38e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:20.806883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9d61-bf55-4e99-8e24-389ccc38e3d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.807164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9d61-bf55-4e99-8e24-389ccc38e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.807804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9d61-bf55-4e99-8e24-389ccc38e3d2 admin admin] PATH_INFO: `/v3/projects/1ec3563deeab4c20b242495f14110e79/users/aab60901a0e7405482570a254b84736b/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.807919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7aa31305-76a9-45da-84d6-7649d6c169f2 None None] MFA Rules not processed for user `e885bb7e601e4ef49a06cfe1170150d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:20.809131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7aa31305-76a9-45da-84d6-7649d6c169f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:20.825234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de9d61-bf55-4e99-8e24-389ccc38e3d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ec3563deeab4c20b242495f14110e79, user_id=aab60901a0e7405482570a254b84736b, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:20.828579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de9d61-bf55-4e99-8e24-389ccc38e3d2 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:20.856825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 953/1926] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:20 2022] PUT /identity/v3/projects/1ec3563deeab4c20b242495f14110e79/users/aab60901a0e7405482570a254b84736b/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:20.867891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fba031-d115-444f-adcd-43cee2a4547c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:20.868249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fba031-d115-444f-adcd-43cee2a4547c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:20.868493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fba031-d115-444f-adcd-43cee2a4547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:20.880632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 974/1927] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:20.897264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-37fba031-d115-444f-adcd-43cee2a4547c None None] MFA Rules not processed for user `aab60901a0e7405482570a254b84736b`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:20.898527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-37fba031-d115-444f-adcd-43cee2a4547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:20.941323 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:20.983355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 954/1928] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:20.988020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31305-76a9-45da-84d6-7649d6c169f2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:20.999443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa31305-76a9-45da-84d6-7649d6c169f2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:21.044136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:21.098539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5402-4ca9-4025-96d1-da79c9fb51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:21.099357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5402-4ca9-4025-96d1-da79c9fb51da admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:21.099831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5402-4ca9-4025-96d1-da79c9fb51da admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:21.100232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e5402-4ca9-4025-96d1-da79c9fb51da admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:21.101166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e5402-4ca9-4025-96d1-da79c9fb51da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:21.104372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e5402-4ca9-4025-96d1-da79c9fb51da admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:21.136121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 975/1929] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:20 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:21.137600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fba031-d115-444f-adcd-43cee2a4547c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:21.150481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fba031-d115-444f-adcd-43cee2a4547c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:21.223291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713c69-6050-45e8-bef6-fe8a9c097c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:21.224207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713c69-6050-45e8-bef6-fe8a9c097c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:21.224609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713c69-6050-45e8-bef6-fe8a9c097c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:21.224991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49713c69-6050-45e8-bef6-fe8a9c097c50 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:21.225842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713c69-6050-45e8-bef6-fe8a9c097c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:21.237979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49713c69-6050-45e8-bef6-fe8a9c097c50 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:21.275728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5402-4ca9-4025-96d1-da79c9fb51da admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:21.283706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 955/1930] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:21 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:21.290216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e5402-4ca9-4025-96d1-da79c9fb51da admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:21.309189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03d61-4d0c-4723-8b0b-05fd73af3ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:21.309819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03d61-4d0c-4723-8b0b-05fd73af3ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:21.310123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03d61-4d0c-4723-8b0b-05fd73af3ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:21.310401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03d61-4d0c-4723-8b0b-05fd73af3ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:21.312365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e03d61-4d0c-4723-8b0b-05fd73af3ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:21.314102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e03d61-4d0c-4723-8b0b-05fd73af3ce1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:21.333868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 976/1931] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:21.338299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713c69-6050-45e8-bef6-fe8a9c097c50 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:21.349711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49713c69-6050-45e8-bef6-fe8a9c097c50 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:21.357015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd7b6-d763-44b8-a100-c2edeed8f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:21.358296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd7b6-d763-44b8-a100-c2edeed8f083 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:21.366497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd7b6-d763-44b8-a100-c2edeed8f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:21.367064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fbd7b6-d763-44b8-a100-c2edeed8f083 admin admin] PATH_INFO: `/v3/projects/48e832a4ba6144819dbca04562c7132c/users/5849407f7def49debcf4d43c47f8355a/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:21.385462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbd7b6-d763-44b8-a100-c2edeed8f083 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e832a4ba6144819dbca04562c7132c, user_id=5849407f7def49debcf4d43c47f8355a, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:21.389548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fbd7b6-d763-44b8-a100-c2edeed8f083 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:21.410184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 956/1932] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:21 2022] PUT /identity/v3/projects/48e832a4ba6144819dbca04562c7132c/users/5849407f7def49debcf4d43c47f8355a/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:21.420470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03d61-4d0c-4723-8b0b-05fd73af3ce1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:21.438950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03d61-4d0c-4723-8b0b-05fd73af3ce1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:21.505579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247ba43-bc7a-490d-baa8-e392d10659c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:21.506320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ba43-bc7a-490d-baa8-e392d10659c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:21.506671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ba43-bc7a-490d-baa8-e392d10659c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:21.507015 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247ba43-bc7a-490d-baa8-e392d10659c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:21.508029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247ba43-bc7a-490d-baa8-e392d10659c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:21.509860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c247ba43-bc7a-490d-baa8-e392d10659c3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:21.527704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 977/1933] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:21.528244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd7b6-d763-44b8-a100-c2edeed8f083 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:21.546744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fbd7b6-d763-44b8-a100-c2edeed8f083 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:21.561515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:21.562381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:21.562670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:21.563835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] PATH_INFO: `/v3/projects/48e832a4ba6144819dbca04562c7132c/users/5849407f7def49debcf4d43c47f8355a/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:21.569271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e832a4ba6144819dbca04562c7132c, user_id=5849407f7def49debcf4d43c47f8355a, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:21.574742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:21.587708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 957/1934] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:21 2022] PUT /identity/v3/projects/48e832a4ba6144819dbca04562c7132c/users/5849407f7def49debcf4d43c47f8355a/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:21.600299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74425de4-54ac-4481-adfe-3663ef33531c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:21.600705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74425de4-54ac-4481-adfe-3663ef33531c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:21.601061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74425de4-54ac-4481-adfe-3663ef33531c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:21.654282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-74425de4-54ac-4481-adfe-3663ef33531c None None] MFA Rules not processed for user `5849407f7def49debcf4d43c47f8355a`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:21.658241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-74425de4-54ac-4481-adfe-3663ef33531c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:21.780182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 978/1935] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:21.791724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:21.793510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:21.866936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7357d5-96cc-4d90-96af-df27807bd0c9 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:21.876542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eea18-ede0-4fb7-a2a2-bec7889cf466 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:21.877364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eea18-ede0-4fb7-a2a2-bec7889cf466 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:21.877719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eea18-ede0-4fb7-a2a2-bec7889cf466 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:21.878029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eea18-ede0-4fb7-a2a2-bec7889cf466 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:21.889167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eea18-ede0-4fb7-a2a2-bec7889cf466 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:21.890974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eea18-ede0-4fb7-a2a2-bec7889cf466 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:21.912711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 958/1936] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:22.526046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74425de4-54ac-4481-adfe-3663ef33531c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:22.536410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74425de4-54ac-4481-adfe-3663ef33531c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:22.541510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82904-eb5f-49ee-958b-a047645e5120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:22.542190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82904-eb5f-49ee-958b-a047645e5120 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:22.542477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82904-eb5f-49ee-958b-a047645e5120 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:22.542750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee82904-eb5f-49ee-958b-a047645e5120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:22.576653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:22.609284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee82904-eb5f-49ee-958b-a047645e5120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:22.611073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee82904-eb5f-49ee-958b-a047645e5120 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:22.621629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 979/1937] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:26.889699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eea18-ede0-4fb7-a2a2-bec7889cf466 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:26.902612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eea18-ede0-4fb7-a2a2-bec7889cf466 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:26.906431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da137f-a462-4294-aaaa-ebe00a911fb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:26.907160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da137f-a462-4294-aaaa-ebe00a911fb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:26.907519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da137f-a462-4294-aaaa-ebe00a911fb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:26.907919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da137f-a462-4294-aaaa-ebe00a911fb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:26.947033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:26.978295 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da137f-a462-4294-aaaa-ebe00a911fb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:26.980122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da137f-a462-4294-aaaa-ebe00a911fb6 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:26.991135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 959/1938] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:29.326161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82904-eb5f-49ee-958b-a047645e5120 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:29.421882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee82904-eb5f-49ee-958b-a047645e5120 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:29.427205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:29.428733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:29.428852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:29.429051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] PATH_INFO: `/v3/users/f07a638061104303846c943771eca082` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:29.430372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f07a638061104303846c943771eca082)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:29.432415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:29.522865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f07a638061104303846c943771eca082'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:29.528392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f07a638061104303846c943771eca082'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:29.545426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f07a638061104303846c943771eca082'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:29.576153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f07a638061104303846c943771eca082'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:29.578644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f07a638061104303846c943771eca082'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:29.614883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 980/1939] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:29 2022] DELETE /identity/v3/users/f07a638061104303846c943771eca082 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:29.619631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf5b9-e7f0-48d3-abf3-386e9a2ade65 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:29.620895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf5b9-e7f0-48d3-abf3-386e9a2ade65 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:29.621444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0bf5b9-e7f0-48d3-abf3-386e9a2ade65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:29.654237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-bb0bf5b9-e7f0-48d3-abf3-386e9a2ade65 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:29.656611 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-bb0bf5b9-e7f0-48d3-abf3-386e9a2ade65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:29.772025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 960/1940] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:29.782472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:29.784206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:29.884024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:29.890558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3eed8-b995-46c1-bc84-b51d0bc72eea admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:29.898154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f80b7-672f-43e8-bfd9-9f818b1ef3b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:29.903655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f80b7-672f-43e8-bfd9-9f818b1ef3b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:29.903655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f80b7-672f-43e8-bfd9-9f818b1ef3b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:29.904848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f80b7-672f-43e8-bfd9-9f818b1ef3b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:29.916263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f80b7-672f-43e8-bfd9-9f818b1ef3b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:29.917783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f80b7-672f-43e8-bfd9-9f818b1ef3b1 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:29.930190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 981/1941] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:30.852107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bf5b9-e7f0-48d3-abf3-386e9a2ade65 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:30.853965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-bb0bf5b9-e7f0-48d3-abf3-386e9a2ade65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:30.867593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0bf5b9-e7f0-48d3-abf3-386e9a2ade65 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:30.872945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:30.874095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:30.875001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:30.875696 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] PATH_INFO: `/v3/projects/3cbcecfbead24ad6ba4835f07e4a4f49` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:30.877085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cbcecfbead24ad6ba4835f07e4a4f49)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:30.879463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:30.958476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cbcecfbead24ad6ba4835f07e4a4f49', 'request_id': 'req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:30.968479 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cbcecfbead24ad6ba4835f07e4a4f49', 'request_id': 'req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:30.975809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cbcecfbead24ad6ba4835f07e4a4f49', 'request_id': 'req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:30.988381 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] The token cache is being invalidate because project 3cbcecfbead24ad6ba4835f07e4a4f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:30.988736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:30.989454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:30.991268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 961/1942] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:30 2022] DELETE /identity/v3/projects/3cbcecfbead24ad6ba4835f07e4a4f49 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:30.995219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f80b7-672f-43e8-bfd9-9f818b1ef3b1 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:31.009067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f80b7-672f-43e8-bfd9-9f818b1ef3b1 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:31.085514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:31.086416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:31.086822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:31.087109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] PATH_INFO: `/v3/users/aab60901a0e7405482570a254b84736b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:31.092691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aab60901a0e7405482570a254b84736b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:31.096593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:31.151561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aab60901a0e7405482570a254b84736b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.152239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aab60901a0e7405482570a254b84736b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.161280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aab60901a0e7405482570a254b84736b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.172147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aab60901a0e7405482570a254b84736b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.173169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aab60901a0e7405482570a254b84736b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.192314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 982/1943] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:30 2022] DELETE /identity/v3/users/aab60901a0e7405482570a254b84736b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:31.717556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:31.719430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:31.751918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0d64-794c-43a2-b82c-b8a468cf4d5e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:31.838214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:31.851653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:31.853426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:31.862117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:31.862402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] PATH_INFO: `/v3/projects/1ec3563deeab4c20b242495f14110e79` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:31.866645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ec3563deeab4c20b242495f14110e79)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:31.868753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:31.928428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ec3563deeab4c20b242495f14110e79', 'request_id': 'req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.936955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ec3563deeab4c20b242495f14110e79', 'request_id': 'req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.946902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ec3563deeab4c20b242495f14110e79', 'request_id': 'req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.959071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] The token cache is being invalidate because project 1ec3563deeab4c20b242495f14110e79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:31.959411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.960135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:31.961777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 962/1944] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:31 2022] DELETE /identity/v3/projects/1ec3563deeab4c20b242495f14110e79 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:31.966888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:31.969184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:31.983875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1232a-5580-4077-acfb-2def2fad1fd9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:32.075490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:32.077453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:32.077976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:32.078403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] PATH_INFO: `/v3/users/5849407f7def49debcf4d43c47f8355a` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:32.080870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5849407f7def49debcf4d43c47f8355a)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:32.096424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:32.145394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:32.208753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5849407f7def49debcf4d43c47f8355a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.209422 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5849407f7def49debcf4d43c47f8355a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.219171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5849407f7def49debcf4d43c47f8355a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.228095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5849407f7def49debcf4d43c47f8355a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.229617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e31d1c20-1f1c-4968-b976-896710a42cdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5849407f7def49debcf4d43c47f8355a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.255197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 983/1945] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:31 2022] DELETE /identity/v3/users/5849407f7def49debcf4d43c47f8355a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:32.564342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:32.566153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:32.583697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb9bcbb-c3e6-47d2-878c-ec09bcdff4d2 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:32.660945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:32.661833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:32.662115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:32.662387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] PATH_INFO: `/v3/projects/48e832a4ba6144819dbca04562c7132c` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:32.663671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e832a4ba6144819dbca04562c7132c)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:32.665660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:32.721793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e832a4ba6144819dbca04562c7132c', 'request_id': 'req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.730187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e832a4ba6144819dbca04562c7132c', 'request_id': 'req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.736364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e832a4ba6144819dbca04562c7132c', 'request_id': 'req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.749739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] The token cache is being invalidate because project 48e832a4ba6144819dbca04562c7132c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:32.750030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.750692 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d4a9eb1-9ab9-4d64-a3d2-7697b2c6c110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:32.752356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 963/1946] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:32 2022] DELETE /identity/v3/projects/48e832a4ba6144819dbca04562c7132c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:32.759657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7727a-878a-491c-86bc-8e06805a07a8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:32.759947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7727a-878a-491c-86bc-8e06805a07a8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:32.760221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7727a-878a-491c-86bc-8e06805a07a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:32.779878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c9c7727a-878a-491c-86bc-8e06805a07a8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:32.781128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c9c7727a-878a-491c-86bc-8e06805a07a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:32.843083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 984/1947] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:32.851392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc874b7d-ea8c-4512-aa3c-5e8075029947 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:32.851774 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc874b7d-ea8c-4512-aa3c-5e8075029947 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:32.852091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc874b7d-ea8c-4512-aa3c-5e8075029947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:32.872301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-dc874b7d-ea8c-4512-aa3c-5e8075029947 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:32.874234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-dc874b7d-ea8c-4512-aa3c-5e8075029947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:32.882696 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 964/1948] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:32.886557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7727a-878a-491c-86bc-8e06805a07a8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:32.897888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7727a-878a-491c-86bc-8e06805a07a8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:32.903613 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:32.905156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:32.905156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:32.905156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:32.905822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:32.906197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:32.908055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:32.922433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 985/1949] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:32.926519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc874b7d-ea8c-4512-aa3c-5e8075029947 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:32.937544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc874b7d-ea8c-4512-aa3c-5e8075029947 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:32.943307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02766-74fa-4fa9-97b1-17063e09bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:32.944120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02766-74fa-4fa9-97b1-17063e09bbf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:32.944403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02766-74fa-4fa9-97b1-17063e09bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:32.944677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed02766-74fa-4fa9-97b1-17063e09bbf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:32.945399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02766-74fa-4fa9-97b1-17063e09bbf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:32.947653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed02766-74fa-4fa9-97b1-17063e09bbf1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:32.953349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:32.981939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 965/1950] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:32 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:32.985991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:32.997677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c3329-5e3a-4ed6-945a-444371953c66 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:33.060237 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990114e1-3449-4abb-b656-13ad57c26e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:33.060926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990114e1-3449-4abb-b656-13ad57c26e60 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:33.061216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990114e1-3449-4abb-b656-13ad57c26e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:33.061497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990114e1-3449-4abb-b656-13ad57c26e60 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:33.062205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990114e1-3449-4abb-b656-13ad57c26e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:33.064177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990114e1-3449-4abb-b656-13ad57c26e60 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:33.085572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 986/1951] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:32 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:33.089796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02766-74fa-4fa9-97b1-17063e09bbf1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:33.100333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed02766-74fa-4fa9-97b1-17063e09bbf1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:33.104975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90bde-1002-4c4a-81d7-7647fc79c20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:33.105646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90bde-1002-4c4a-81d7-7647fc79c20c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:33.105929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90bde-1002-4c4a-81d7-7647fc79c20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:33.106199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d90bde-1002-4c4a-81d7-7647fc79c20c admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:33.106961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90bde-1002-4c4a-81d7-7647fc79c20c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:33.108614 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d90bde-1002-4c4a-81d7-7647fc79c20c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:33.118958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 966/1952] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:33.123136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990114e1-3449-4abb-b656-13ad57c26e60 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:33.133893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990114e1-3449-4abb-b656-13ad57c26e60 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:33.139425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750de265-e6f7-4f89-b623-65ff00db2b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:33.140368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de265-e6f7-4f89-b623-65ff00db2b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:33.140696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de265-e6f7-4f89-b623-65ff00db2b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:33.140967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750de265-e6f7-4f89-b623-65ff00db2b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:33.141714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750de265-e6f7-4f89-b623-65ff00db2b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:33.143324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750de265-e6f7-4f89-b623-65ff00db2b64 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:33.144812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:33.159685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 987/1953] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:33.161457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90bde-1002-4c4a-81d7-7647fc79c20c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:33.172508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d90bde-1002-4c4a-81d7-7647fc79c20c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:33.177220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:33.178712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:33.179206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:33.179485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] PATH_INFO: `/v3/projects/36479fe313c344028feb0183966a88d9/users/443bd86a12bd487fa91dd76751c135c2/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:33.195509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36479fe313c344028feb0183966a88d9, user_id=443bd86a12bd487fa91dd76751c135c2, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:33.198296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:33.212159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 967/1954] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:33 2022] PUT /identity/v3/projects/36479fe313c344028feb0183966a88d9/users/443bd86a12bd487fa91dd76751c135c2/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:33.223493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f252e-048d-4198-ba7d-29c5dab52609 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:33.223816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f252e-048d-4198-ba7d-29c5dab52609 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:33.224096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f252e-048d-4198-ba7d-29c5dab52609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:33.250974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-855f252e-048d-4198-ba7d-29c5dab52609 None None] MFA Rules not processed for user `443bd86a12bd487fa91dd76751c135c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:33.252207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-855f252e-048d-4198-ba7d-29c5dab52609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:33.316559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 988/1955] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:33.328514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:33.330415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:33.396238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b3333f-17bd-4641-b968-7209ee859dc5 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:33.400601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5faab43-6d62-446b-a39c-18016940e9d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:33.401400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faab43-6d62-446b-a39c-18016940e9d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:33.401707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faab43-6d62-446b-a39c-18016940e9d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:33.402531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5faab43-6d62-446b-a39c-18016940e9d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:33.411759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5faab43-6d62-446b-a39c-18016940e9d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:33.413197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5faab43-6d62-446b-a39c-18016940e9d1 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:33.424104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 968/1956] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:40.607897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f252e-048d-4198-ba7d-29c5dab52609 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:40.610436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-855f252e-048d-4198-ba7d-29c5dab52609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:40.727242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f252e-048d-4198-ba7d-29c5dab52609 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:40.732900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:40.733932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:40.734294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:40.735035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] PATH_INFO: `/v3/users/f3a7a8ebfb1e43a2a7d48cf1a5fbccdd` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:40.736091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a7a8ebfb1e43a2a7d48cf1a5fbccdd)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:40.738305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:40.806290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a7a8ebfb1e43a2a7d48cf1a5fbccdd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:40.807874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a7a8ebfb1e43a2a7d48cf1a5fbccdd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:40.818312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a7a8ebfb1e43a2a7d48cf1a5fbccdd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:40.829599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a7a8ebfb1e43a2a7d48cf1a5fbccdd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:40.830711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a7a8ebfb1e43a2a7d48cf1a5fbccdd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:40.850263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 989/1957] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:40 2022] DELETE /identity/v3/users/f3a7a8ebfb1e43a2a7d48cf1a5fbccdd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:40.855376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550f14-025b-4fa3-9491-4c5e5db59ab4 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:40.855920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550f14-025b-4fa3-9491-4c5e5db59ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:40.856366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3550f14-025b-4fa3-9491-4c5e5db59ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:40.874434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d3550f14-025b-4fa3-9491-4c5e5db59ab4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:40.875706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d3550f14-025b-4fa3-9491-4c5e5db59ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:40.935937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 969/1958] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:40.947856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:40.949511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:40.957379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:41.013809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81547e9e-1d81-4595-8be6-2548bbbcd37f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:41.017999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12670149-47af-4d7c-ae38-62a4f48e15cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:41.018706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670149-47af-4d7c-ae38-62a4f48e15cd service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.018979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670149-47af-4d7c-ae38-62a4f48e15cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.019261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12670149-47af-4d7c-ae38-62a4f48e15cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.029390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12670149-47af-4d7c-ae38-62a4f48e15cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:41.030841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12670149-47af-4d7c-ae38-62a4f48e15cd service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:41.041229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 990/1959] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:41.439884 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550f14-025b-4fa3-9491-4c5e5db59ab4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:41.441910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d3550f14-025b-4fa3-9491-4c5e5db59ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:41.457183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3550f14-025b-4fa3-9491-4c5e5db59ab4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:41.463489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:41.464419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.465433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.465730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] PATH_INFO: `/v3/projects/536d0cf3e9f044a8a988256776909ee0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.467278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=536d0cf3e9f044a8a988256776909ee0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:41.469294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:41.525949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:41.532282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536d0cf3e9f044a8a988256776909ee0', 'request_id': 'req-edb5662f-f3aa-42dd-9556-50a65bbb74ba'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:41.543059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536d0cf3e9f044a8a988256776909ee0', 'request_id': 'req-edb5662f-f3aa-42dd-9556-50a65bbb74ba'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:41.552832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536d0cf3e9f044a8a988256776909ee0', 'request_id': 'req-edb5662f-f3aa-42dd-9556-50a65bbb74ba'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:41.570752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] The token cache is being invalidate because project 536d0cf3e9f044a8a988256776909ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:41.570752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:41.581306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-edb5662f-f3aa-42dd-9556-50a65bbb74ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:41.583169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 970/1960] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:41 2022] DELETE /identity/v3/projects/536d0cf3e9f044a8a988256776909ee0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:41.588332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88d10-896c-4f23-b690-0ad71eea7371 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.588630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88d10-896c-4f23-b690-0ad71eea7371 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.588925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d88d10-896c-4f23-b690-0ad71eea7371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.608041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-05d88d10-896c-4f23-b690-0ad71eea7371 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:41.609271 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-05d88d10-896c-4f23-b690-0ad71eea7371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:41.683270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 991/1961] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:41.687874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cb214-44e8-49fd-b195-5b80153d4781 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.688171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cb214-44e8-49fd-b195-5b80153d4781 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.688452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cb214-44e8-49fd-b195-5b80153d4781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.708019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-912cb214-44e8-49fd-b195-5b80153d4781 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:41.709407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-912cb214-44e8-49fd-b195-5b80153d4781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:41.718474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 971/1962] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:41.723133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d88d10-896c-4f23-b690-0ad71eea7371 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:41.734577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d88d10-896c-4f23-b690-0ad71eea7371 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:41.739175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:41.739880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.740163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.740437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.741184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:41.741498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:41.743106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:41.756128 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 992/1963] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:42:41.761068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cb214-44e8-49fd-b195-5b80153d4781 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:41.772321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cb214-44e8-49fd-b195-5b80153d4781 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:41.777413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0d94-c753-45a0-9e5d-bd07d8b32eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:41.778060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0d94-c753-45a0-9e5d-bd07d8b32eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.778379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0d94-c753-45a0-9e5d-bd07d8b32eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.778657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a0d94-c753-45a0-9e5d-bd07d8b32eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.779357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a0d94-c753-45a0-9e5d-bd07d8b32eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:41.781326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a0d94-c753-45a0-9e5d-bd07d8b32eb8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:41.812383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 972/1964] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:41 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:41.814335 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:41.826267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba71782c-86fd-49c0-b787-8be0f036ba95 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:41.897641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16fd6-1782-4dc0-a6b7-56f0ad61b418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:41.898402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16fd6-1782-4dc0-a6b7-56f0ad61b418 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.898760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16fd6-1782-4dc0-a6b7-56f0ad61b418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.899113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16fd6-1782-4dc0-a6b7-56f0ad61b418 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.899878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e16fd6-1782-4dc0-a6b7-56f0ad61b418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:41.901917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e16fd6-1782-4dc0-a6b7-56f0ad61b418 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:41.931828 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 993/1965] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:41 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:41.935801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0d94-c753-45a0-9e5d-bd07d8b32eb8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:41.947810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a0d94-c753-45a0-9e5d-bd07d8b32eb8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:41.953161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98004db6-9e7a-4d40-a6d5-546557d1e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:41.953857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004db6-9e7a-4d40-a6d5-546557d1e047 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.954141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004db6-9e7a-4d40-a6d5-546557d1e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.954420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98004db6-9e7a-4d40-a6d5-546557d1e047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.955160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98004db6-9e7a-4d40-a6d5-546557d1e047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:41.957004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98004db6-9e7a-4d40-a6d5-546557d1e047 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:41.968116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 973/1966] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:41.972462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16fd6-1782-4dc0-a6b7-56f0ad61b418 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:41.984060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16fd6-1782-4dc0-a6b7-56f0ad61b418 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:41.988771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7b0ec8-cfa8-4cd0-afee-4235a91bdc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:41.989672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0ec8-cfa8-4cd0-afee-4235a91bdc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:41.989955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0ec8-cfa8-4cd0-afee-4235a91bdc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:41.990226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7b0ec8-cfa8-4cd0-afee-4235a91bdc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:41.990964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b0ec8-cfa8-4cd0-afee-4235a91bdc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:41.992648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7b0ec8-cfa8-4cd0-afee-4235a91bdc84 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:42.004448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 994/1967] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:42.008714 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98004db6-9e7a-4d40-a6d5-546557d1e047 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:42.019852 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98004db6-9e7a-4d40-a6d5-546557d1e047 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:42.027092 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:42.027910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:42.028728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:42.028728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] PATH_INFO: `/v3/projects/4d3c9a03bc8d43718516e3eb0ae4044e/users/dc592fd37cc548aa82c5ffab1919cc83/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:42.052540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d3c9a03bc8d43718516e3eb0ae4044e, user_id=dc592fd37cc548aa82c5ffab1919cc83, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:42.055674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:42.071404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 974/1968] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:42 2022] PUT /identity/v3/projects/4d3c9a03bc8d43718516e3eb0ae4044e/users/dc592fd37cc548aa82c5ffab1919cc83/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:42.083166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d1dfc-8e79-4295-b636-c99414a1d173 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:42.083506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d1dfc-8e79-4295-b636-c99414a1d173 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:42.083917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d1dfc-8e79-4295-b636-c99414a1d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:42.117661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:42.122726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e39d1dfc-8e79-4295-b636-c99414a1d173 None None] MFA Rules not processed for user `dc592fd37cc548aa82c5ffab1919cc83`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:42.124392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e39d1dfc-8e79-4295-b636-c99414a1d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:42.236945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 995/1969] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:42.253279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:42.255934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:42.374114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5d71b4-95c7-48c9-a251-19cd5f464b9d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:42.380042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6251972a-fc03-4237-b958-7cc0360bba42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:42.380938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251972a-fc03-4237-b958-7cc0360bba42 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:42.381301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251972a-fc03-4237-b958-7cc0360bba42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:42.381731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6251972a-fc03-4237-b958-7cc0360bba42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:42.392843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251972a-fc03-4237-b958-7cc0360bba42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:42.394473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6251972a-fc03-4237-b958-7cc0360bba42 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:42.419326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 975/1970] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:42.450292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d1dfc-8e79-4295-b636-c99414a1d173 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:42.582650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d1dfc-8e79-4295-b636-c99414a1d173 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:42.590286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:42.591320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:42.591759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:42.592165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] PATH_INFO: `/v3/users/dc592fd37cc548aa82c5ffab1919cc83` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:42.593583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc592fd37cc548aa82c5ffab1919cc83)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:42.595837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:42.686433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc592fd37cc548aa82c5ffab1919cc83'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:42.687620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc592fd37cc548aa82c5ffab1919cc83'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:42.709260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc592fd37cc548aa82c5ffab1919cc83'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:42.724297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc592fd37cc548aa82c5ffab1919cc83'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:42.725990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc592fd37cc548aa82c5ffab1919cc83'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:42.791310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 996/1971] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:42 2022] DELETE /identity/v3/users/dc592fd37cc548aa82c5ffab1919cc83 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:42.799948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4772f-9815-42cd-9b02-48f2877e6295 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:42.800287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4772f-9815-42cd-9b02-48f2877e6295 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:42.801986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae4772f-9815-42cd-9b02-48f2877e6295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:42.827107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-cae4772f-9815-42cd-9b02-48f2877e6295 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:42.828507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cae4772f-9815-42cd-9b02-48f2877e6295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:42.910939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 976/1972] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:42.921526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:42.923138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:42.985664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:43.033402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf1cfe-03ea-4a0b-b862-e14f1c71f86e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:43.037434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb8cefa-51a3-499b-9d6d-4ff82a3b7751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:43.038255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cefa-51a3-499b-9d6d-4ff82a3b7751 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.038698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cefa-51a3-499b-9d6d-4ff82a3b7751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.039109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb8cefa-51a3-499b-9d6d-4ff82a3b7751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.056571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8cefa-51a3-499b-9d6d-4ff82a3b7751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:43.058382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb8cefa-51a3-499b-9d6d-4ff82a3b7751 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:43.070358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 997/1973] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:42:43.459087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4772f-9815-42cd-9b02-48f2877e6295 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:43.460997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cae4772f-9815-42cd-9b02-48f2877e6295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:43.475307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae4772f-9815-42cd-9b02-48f2877e6295 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:43.480329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:43.481754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.482039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.482383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] PATH_INFO: `/v3/projects/4d3c9a03bc8d43718516e3eb0ae4044e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.484265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d3c9a03bc8d43718516e3eb0ae4044e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:43.488179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:43.499547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:43.543445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d3c9a03bc8d43718516e3eb0ae4044e', 'request_id': 'req-f62aae6a-b92b-4791-a28c-2da22a08a688'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:43.552646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d3c9a03bc8d43718516e3eb0ae4044e', 'request_id': 'req-f62aae6a-b92b-4791-a28c-2da22a08a688'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:43.558914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d3c9a03bc8d43718516e3eb0ae4044e', 'request_id': 'req-f62aae6a-b92b-4791-a28c-2da22a08a688'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:43.570606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] The token cache is being invalidate because project 4d3c9a03bc8d43718516e3eb0ae4044e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:43.570887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:43.571549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f62aae6a-b92b-4791-a28c-2da22a08a688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:43.573185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 977/1974] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:43 2022] DELETE /identity/v3/projects/4d3c9a03bc8d43718516e3eb0ae4044e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:43.578605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd8096-db60-4ab9-958f-60ec3380957c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.578839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd8096-db60-4ab9-958f-60ec3380957c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.579124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd8096-db60-4ab9-958f-60ec3380957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.605639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a2bd8096-db60-4ab9-958f-60ec3380957c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:43.606910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a2bd8096-db60-4ab9-958f-60ec3380957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:43.676811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 998/1975] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:43.685109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799063-5319-494f-b8f8-1b97c552f6ec None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.685400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799063-5319-494f-b8f8-1b97c552f6ec None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.685675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8799063-5319-494f-b8f8-1b97c552f6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.707879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b8799063-5319-494f-b8f8-1b97c552f6ec None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:43.709169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b8799063-5319-494f-b8f8-1b97c552f6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:43.718632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 978/1976] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:43.723454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd8096-db60-4ab9-958f-60ec3380957c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:43.734306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd8096-db60-4ab9-958f-60ec3380957c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:43.740277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:43.740990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.741281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.741558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.742303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:43.742612 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:43.744256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:43.757129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 999/1977] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:43.763045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799063-5319-494f-b8f8-1b97c552f6ec None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:43.773119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8799063-5319-494f-b8f8-1b97c552f6ec None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:43.779087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93413662-f8dc-4b33-b5bf-2acc523da3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:43.779874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93413662-f8dc-4b33-b5bf-2acc523da3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.780161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93413662-f8dc-4b33-b5bf-2acc523da3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.780438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93413662-f8dc-4b33-b5bf-2acc523da3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.781169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93413662-f8dc-4b33-b5bf-2acc523da3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:43.783132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93413662-f8dc-4b33-b5bf-2acc523da3f4 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:43.811807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 979/1978] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:43 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:43.816279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:43.826983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8391e0aa-255a-4501-913b-b87a2292b3a9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:43.888673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fda2-2f07-452b-b47e-356e316105a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:43.889248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fda2-2f07-452b-b47e-356e316105a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.889529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fda2-2f07-452b-b47e-356e316105a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.889800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fda2-2f07-452b-b47e-356e316105a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.890496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fda2-2f07-452b-b47e-356e316105a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:43.892490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fda2-2f07-452b-b47e-356e316105a7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:43.917487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1000/1979] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:43 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:43.921953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93413662-f8dc-4b33-b5bf-2acc523da3f4 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:43.933409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93413662-f8dc-4b33-b5bf-2acc523da3f4 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:43.938142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f381c-26f5-4ddc-8922-a1c414f3cdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:43.938829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f381c-26f5-4ddc-8922-a1c414f3cdec admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.939114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f381c-26f5-4ddc-8922-a1c414f3cdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.939394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f381c-26f5-4ddc-8922-a1c414f3cdec admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.940646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f381c-26f5-4ddc-8922-a1c414f3cdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:43.942354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f381c-26f5-4ddc-8922-a1c414f3cdec admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:43.953240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 980/1980] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:43.957937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fda2-2f07-452b-b47e-356e316105a7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:43.973127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fda2-2f07-452b-b47e-356e316105a7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:43.976180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8def6-c56e-46a6-8320-92dcbf150f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:43.976898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8def6-c56e-46a6-8320-92dcbf150f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:43.977179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8def6-c56e-46a6-8320-92dcbf150f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:43.977454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8def6-c56e-46a6-8320-92dcbf150f01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:43.978216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8def6-c56e-46a6-8320-92dcbf150f01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:43.979834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8def6-c56e-46a6-8320-92dcbf150f01 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:43.990127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1001/1981] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:43.994431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f381c-26f5-4ddc-8922-a1c414f3cdec admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:44.005136 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f381c-26f5-4ddc-8922-a1c414f3cdec admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:44.011412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:44.012452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:44.012736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:44.013011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] PATH_INFO: `/v3/projects/076373845ff3474095725063f8a3b5d0/users/09a69bba369d4037ae66e240eb8e556b/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:44.030363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=076373845ff3474095725063f8a3b5d0, user_id=09a69bba369d4037ae66e240eb8e556b, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:44.033850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:44.050663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 981/1982] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:43 2022] PUT /identity/v3/projects/076373845ff3474095725063f8a3b5d0/users/09a69bba369d4037ae66e240eb8e556b/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:44.057272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e045a-3abc-4185-8f41-050a98ae42c2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:44.057569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e045a-3abc-4185-8f41-050a98ae42c2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:44.057911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e045a-3abc-4185-8f41-050a98ae42c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:44.079665 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e68e045a-3abc-4185-8f41-050a98ae42c2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:44.080904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e68e045a-3abc-4185-8f41-050a98ae42c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:44.109652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:44.147295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1002/1983] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:44.157358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:44.159305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:44.224953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4474d3c-6150-4992-87da-605dd6822bc1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:44.229494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:44.230169 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:44.230456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:44.230731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:44.241164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:44.242894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:44.254283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 982/1984] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:44.952345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e68f-d850-458a-b0af-b14031fc3932 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:44.952856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e68f-d850-458a-b0af-b14031fc3932 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:44.952955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0e68f-d850-458a-b0af-b14031fc3932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:44.982749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-90e0e68f-d850-458a-b0af-b14031fc3932 None None] MFA Rules not processed for user `09a69bba369d4037ae66e240eb8e556b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:44.984213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-90e0e68f-d850-458a-b0af-b14031fc3932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:45.091981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1003/1985] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:45.104757 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:45.106476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:45.161549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:45.192203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead86a0-9dc9-4457-8432-7d1d71098339 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:45.197113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:45.198035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:45.198419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:45.198806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:45.208794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:45.210278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:45.219618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 983/1986] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:46.593245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c35004-04ea-45b9-b17d-fe69412f22e6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:46.593936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c35004-04ea-45b9-b17d-fe69412f22e6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:46.593936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c35004-04ea-45b9-b17d-fe69412f22e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:46.614967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b2c35004-04ea-45b9-b17d-fe69412f22e6 None None] MFA Rules not processed for user `09a69bba369d4037ae66e240eb8e556b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:46.616369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b2c35004-04ea-45b9-b17d-fe69412f22e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:46.623699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1004/1987] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:48.674012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:48.675721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:48.691188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c13ba4-db52-4f10-8f53-e1511c576360 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:48.696366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:48.697222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:48.697503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:48.697776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] PATH_INFO: `/v3/users/443bd86a12bd487fa91dd76751c135c2` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:48.699027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=443bd86a12bd487fa91dd76751c135c2)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:48.701008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:48.753562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443bd86a12bd487fa91dd76751c135c2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:48.762072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443bd86a12bd487fa91dd76751c135c2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:48.762710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443bd86a12bd487fa91dd76751c135c2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:48.770681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443bd86a12bd487fa91dd76751c135c2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:48.782853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443bd86a12bd487fa91dd76751c135c2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:48.789389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 984/1988] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:48 2022] DELETE /identity/v3/users/443bd86a12bd487fa91dd76751c135c2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:48.794081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5b611-285f-4f15-b63f-6fd2aa717314 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:48.794549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5b611-285f-4f15-b63f-6fd2aa717314 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:48.794639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5b611-285f-4f15-b63f-6fd2aa717314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:48.812628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3ce5b611-285f-4f15-b63f-6fd2aa717314 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:48.813866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3ce5b611-285f-4f15-b63f-6fd2aa717314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:48.873763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1005/1989] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:48.883688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:48.885210 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:48.949135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd7c05-e221-4881-8cbd-2b58272169dd admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:48.953257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1dc34-3cb5-4735-bb09-d5e995c4f2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:48.953910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1dc34-3cb5-4735-bb09-d5e995c4f2fa service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:48.954194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1dc34-3cb5-4735-bb09-d5e995c4f2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:48.954466 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1dc34-3cb5-4735-bb09-d5e995c4f2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:48.964077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1dc34-3cb5-4735-bb09-d5e995c4f2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:48.965527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1dc34-3cb5-4735-bb09-d5e995c4f2fa service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:48.975218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 985/1990] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:49.516887 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5b611-285f-4f15-b63f-6fd2aa717314 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:49.518375 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3ce5b611-285f-4f15-b63f-6fd2aa717314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:49.531705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5b611-285f-4f15-b63f-6fd2aa717314 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:49.542517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:49.543531 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:49.543969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:49.544349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] PATH_INFO: `/v3/projects/36479fe313c344028feb0183966a88d9` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:49.545931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36479fe313c344028feb0183966a88d9)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:49.547863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:49.596994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36479fe313c344028feb0183966a88d9', 'request_id': 'req-11a2410a-4d66-41f0-b0ee-259332309e88'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:49.598040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:49.605393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36479fe313c344028feb0183966a88d9', 'request_id': 'req-11a2410a-4d66-41f0-b0ee-259332309e88'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:49.613362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36479fe313c344028feb0183966a88d9', 'request_id': 'req-11a2410a-4d66-41f0-b0ee-259332309e88'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:49.623924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] The token cache is being invalidate because project 36479fe313c344028feb0183966a88d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:49.624216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:49.624843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-11a2410a-4d66-41f0-b0ee-259332309e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:49.626407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1006/1991] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:49 2022] DELETE /identity/v3/projects/36479fe313c344028feb0183966a88d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:49.631339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd008-80c3-47c3-8359-93189f21947c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:49.631667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd008-80c3-47c3-8359-93189f21947c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:49.631954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fd008-80c3-47c3-8359-93189f21947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:49.651494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-cd7fd008-80c3-47c3-8359-93189f21947c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:49.652778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cd7fd008-80c3-47c3-8359-93189f21947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:49.704838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:49.720520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 986/1992] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:49.731403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d14fd-41ed-4a56-be69-3d195c3c17e7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:49.731723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d14fd-41ed-4a56-be69-3d195c3c17e7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:49.732003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7d14fd-41ed-4a56-be69-3d195c3c17e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:49.750645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cd7d14fd-41ed-4a56-be69-3d195c3c17e7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:49.751907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cd7d14fd-41ed-4a56-be69-3d195c3c17e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:49.761327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1007/1993] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:49.766920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd008-80c3-47c3-8359-93189f21947c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:49.779192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fd008-80c3-47c3-8359-93189f21947c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:49.785988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:49.786830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:49.787115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:49.787424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:49.788355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:49.788671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:49.790638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:49.804688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 987/1994] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:49.809232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d14fd-41ed-4a56-be69-3d195c3c17e7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:49.819036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7d14fd-41ed-4a56-be69-3d195c3c17e7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:49.824618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c4be6-146f-4c18-b036-dace402e3f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:49.825317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4be6-146f-4c18-b036-dace402e3f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:49.825598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4be6-146f-4c18-b036-dace402e3f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:49.825869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4be6-146f-4c18-b036-dace402e3f10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:49.826598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c4be6-146f-4c18-b036-dace402e3f10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:49.828597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c4be6-146f-4c18-b036-dace402e3f10 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:49.859823 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1008/1995] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:49 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:49.861100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:49.872157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf1aa1-812b-4178-9593-020487c8be13 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:49.935100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484856f-8a03-4ca3-8dbc-0b816b7eeaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:49.935800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484856f-8a03-4ca3-8dbc-0b816b7eeaae admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:49.936108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484856f-8a03-4ca3-8dbc-0b816b7eeaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:49.936426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484856f-8a03-4ca3-8dbc-0b816b7eeaae admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:49.937207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484856f-8a03-4ca3-8dbc-0b816b7eeaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:49.939907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484856f-8a03-4ca3-8dbc-0b816b7eeaae admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:49.961558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 988/1996] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:49 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:49.965580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c4be6-146f-4c18-b036-dace402e3f10 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:49.976750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c4be6-146f-4c18-b036-dace402e3f10 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:49.982212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43db92-c459-4770-9ac2-a704c5ca8930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:49.982947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43db92-c459-4770-9ac2-a704c5ca8930 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:49.983254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43db92-c459-4770-9ac2-a704c5ca8930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:49.983564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43db92-c459-4770-9ac2-a704c5ca8930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:49.984420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43db92-c459-4770-9ac2-a704c5ca8930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:49.986131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43db92-c459-4770-9ac2-a704c5ca8930 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:49.997570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1009/1997] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:50.001812 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484856f-8a03-4ca3-8dbc-0b816b7eeaae admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:50.012740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484856f-8a03-4ca3-8dbc-0b816b7eeaae admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:50.017863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dc17d-4e03-4016-a5cd-80e705df7cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:50.018540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc17d-4e03-4016-a5cd-80e705df7cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:50.018818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc17d-4e03-4016-a5cd-80e705df7cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:50.019106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dc17d-4e03-4016-a5cd-80e705df7cbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:50.019924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dc17d-4e03-4016-a5cd-80e705df7cbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:50.021538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dc17d-4e03-4016-a5cd-80e705df7cbf admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:50.031722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 989/1998] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:50.035905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43db92-c459-4770-9ac2-a704c5ca8930 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:50.046167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43db92-c459-4770-9ac2-a704c5ca8930 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:50.050988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:50.051989 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:50.052274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:50.052551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] PATH_INFO: `/v3/projects/c7e521ea370a48cea74a6a23cabd6875/users/9ace3acc926b4b5580ff15a060c040ee/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:50.067543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e521ea370a48cea74a6a23cabd6875, user_id=9ace3acc926b4b5580ff15a060c040ee, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:50.070281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:50.084974 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1010/1999] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:50 2022] PUT /identity/v3/projects/c7e521ea370a48cea74a6a23cabd6875/users/9ace3acc926b4b5580ff15a060c040ee/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:50.090270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b967-e3a6-4222-ba3f-99eacd6c3496 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:50.090529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b967-e3a6-4222-ba3f-99eacd6c3496 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:50.090802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915b967-e3a6-4222-ba3f-99eacd6c3496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:50.110616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3915b967-e3a6-4222-ba3f-99eacd6c3496 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:50.111870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3915b967-e3a6-4222-ba3f-99eacd6c3496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:50.178991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 990/2000] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:50.192362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:50.194240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:50.251751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe256f-52f4-47bf-9d39-c60af226318b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:50.255635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:50.256296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:50.256578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:50.256854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:50.266173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:50.267640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:50.277251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1011/2001] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:51.314920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d036f-047d-40fd-bd7e-91dc99b61409 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:51.315753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d036f-047d-40fd-bd7e-91dc99b61409 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:51.315873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d036f-047d-40fd-bd7e-91dc99b61409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:51.341858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-090d036f-047d-40fd-bd7e-91dc99b61409 None None] MFA Rules not processed for user `9ace3acc926b4b5580ff15a060c040ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:51.343210 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-090d036f-047d-40fd-bd7e-91dc99b61409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:51.393126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:51.411998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 991/2002] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:51.422688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:51.424603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:51.494225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f8e9b-d07b-4d65-9a51-1e81d48b69e4 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:51.498107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:51.499341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:51.499341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:51.499541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:51.510358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:51.512063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:51.521672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1012/2003] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:53.019736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3df4-16ef-4fad-b0bd-91fff10608ae None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:53.020377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3df4-16ef-4fad-b0bd-91fff10608ae None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:53.020663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b3df4-16ef-4fad-b0bd-91fff10608ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:53.044832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-844b3df4-16ef-4fad-b0bd-91fff10608ae None None] MFA Rules not processed for user `9ace3acc926b4b5580ff15a060c040ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:53.046457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-844b3df4-16ef-4fad-b0bd-91fff10608ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:53.057458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 992/2004] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:57.939497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:57.942722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:57.962910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eaad89-0958-4f5a-a8e0-7a23d7dc6bb6 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:57.969603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:57.970764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:57.971228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:57.971719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] PATH_INFO: `/v3/users/6bb38e1511e44eca8ebaf7524e4cef80` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:57.973146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb38e1511e44eca8ebaf7524e4cef80)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:57.975713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:58.000467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:58.040208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb38e1511e44eca8ebaf7524e4cef80'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.040917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb38e1511e44eca8ebaf7524e4cef80'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.049592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb38e1511e44eca8ebaf7524e4cef80'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.056408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb38e1511e44eca8ebaf7524e4cef80'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.057042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce14c811-aacd-4e63-a729-515b889412bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb38e1511e44eca8ebaf7524e4cef80'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.074325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1013/2005] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:42:57 2022] DELETE /identity/v3/users/6bb38e1511e44eca8ebaf7524e4cef80 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:58.266690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3df4-16ef-4fad-b0bd-91fff10608ae None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:58.282420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b3df4-16ef-4fad-b0bd-91fff10608ae None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:58.340885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:58.341777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.342055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.342321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] PATH_INFO: `/v3/projects/523620ee15ef4a88b365aa51d7766847` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.343631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523620ee15ef4a88b365aa51d7766847)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:58.345512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:58.404106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523620ee15ef4a88b365aa51d7766847', 'request_id': 'req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.414979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523620ee15ef4a88b365aa51d7766847', 'request_id': 'req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.422456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523620ee15ef4a88b365aa51d7766847', 'request_id': 'req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.434938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] The token cache is being invalidate because project 523620ee15ef4a88b365aa51d7766847 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:42:58.435287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.436032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7b566a0d-f8fd-44a3-9574-2e8fc99f98b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:42:58.437622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 993/2006] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:42:58 2022] DELETE /identity/v3/projects/523620ee15ef4a88b365aa51d7766847 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:58.443556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060c642-4e4a-4490-b312-66ce9c194cee None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.445321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060c642-4e4a-4490-b312-66ce9c194cee None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.445645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060c642-4e4a-4490-b312-66ce9c194cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.472397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2060c642-4e4a-4490-b312-66ce9c194cee None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:58.473725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2060c642-4e4a-4490-b312-66ce9c194cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:58.560609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1014/2007] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:58.571701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638e47-d1f0-4dc6-aefe-84d4fd2d5eea None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.571701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638e47-d1f0-4dc6-aefe-84d4fd2d5eea None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.571701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89638e47-d1f0-4dc6-aefe-84d4fd2d5eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.590995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-89638e47-d1f0-4dc6-aefe-84d4fd2d5eea None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:58.592232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-89638e47-d1f0-4dc6-aefe-84d4fd2d5eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:58.600978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 994/2008] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:42:58.605758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060c642-4e4a-4490-b312-66ce9c194cee None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:58.615579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060c642-4e4a-4490-b312-66ce9c194cee None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:58.620237 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:58.621157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.621157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.621428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.622311 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:42:58.622665 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:58.624233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:58.637204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1015/2009] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:42:58.641383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638e47-d1f0-4dc6-aefe-84d4fd2d5eea None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:58.651441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89638e47-d1f0-4dc6-aefe-84d4fd2d5eea None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:58.662016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0a2a4-13bd-4244-8029-93c0764e4626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:58.662727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a2a4-13bd-4244-8029-93c0764e4626 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.663004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a2a4-13bd-4244-8029-93c0764e4626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.663387 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea0a2a4-13bd-4244-8029-93c0764e4626 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.664168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0a2a4-13bd-4244-8029-93c0764e4626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:58.666240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea0a2a4-13bd-4244-8029-93c0764e4626 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:58.693524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 995/2010] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:58 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:58.698018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:58.708760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bc4797-66c7-47e9-ba2a-ce9b131c7010 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:58.769989 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15c2ed-25af-4002-9057-0be91f862d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:58.770598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c2ed-25af-4002-9057-0be91f862d71 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.770879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c2ed-25af-4002-9057-0be91f862d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.771187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15c2ed-25af-4002-9057-0be91f862d71 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.771946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15c2ed-25af-4002-9057-0be91f862d71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:58.773864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15c2ed-25af-4002-9057-0be91f862d71 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:58.804134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1016/2011] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:58 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:58.808897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0a2a4-13bd-4244-8029-93c0764e4626 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:58.823879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea0a2a4-13bd-4244-8029-93c0764e4626 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:58.829427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76a3d-bdb3-4ce9-a775-7c0fbd82ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:58.830397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76a3d-bdb3-4ce9-a775-7c0fbd82ede1 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.830397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76a3d-bdb3-4ce9-a775-7c0fbd82ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.830728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a76a3d-bdb3-4ce9-a775-7c0fbd82ede1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.831487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76a3d-bdb3-4ce9-a775-7c0fbd82ede1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:58.833176 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a76a3d-bdb3-4ce9-a775-7c0fbd82ede1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:58.845807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 996/2012] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:58.849845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15c2ed-25af-4002-9057-0be91f862d71 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:58.867327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15c2ed-25af-4002-9057-0be91f862d71 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:58.873634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae371a-9b93-48cc-8b4b-3642ccec8aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:58.874473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae371a-9b93-48cc-8b4b-3642ccec8aec admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.874995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae371a-9b93-48cc-8b4b-3642ccec8aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.875250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae371a-9b93-48cc-8b4b-3642ccec8aec admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.876193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae371a-9b93-48cc-8b4b-3642ccec8aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:58.878019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae371a-9b93-48cc-8b4b-3642ccec8aec admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:58.881146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:58.895705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1017/2013] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:42:58.897947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76a3d-bdb3-4ce9-a775-7c0fbd82ede1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:58.914191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a76a3d-bdb3-4ce9-a775-7c0fbd82ede1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:58.919853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95b9a8-77cb-4c9d-8884-de24c3927732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:58.921199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b9a8-77cb-4c9d-8884-de24c3927732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.921549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b9a8-77cb-4c9d-8884-de24c3927732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.921991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95b9a8-77cb-4c9d-8884-de24c3927732 admin admin] PATH_INFO: `/v3/projects/5b402dc451244e26b55dadafc28c835e/users/0aa16eacbb15448daec57aaae5a60ee5/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:58.937535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95b9a8-77cb-4c9d-8884-de24c3927732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b402dc451244e26b55dadafc28c835e, user_id=0aa16eacbb15448daec57aaae5a60ee5, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:58.940236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95b9a8-77cb-4c9d-8884-de24c3927732 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:58.955769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 997/2014] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:58 2022] PUT /identity/v3/projects/5b402dc451244e26b55dadafc28c835e/users/0aa16eacbb15448daec57aaae5a60ee5/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:42:58.965901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cc777-4cac-4753-b969-e29048320c9a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:58.966394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cc777-4cac-4753-b969-e29048320c9a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:58.966485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1cc777-4cac-4753-b969-e29048320c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.012679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ca1cc777-4cac-4753-b969-e29048320c9a None None] MFA Rules not processed for user `0aa16eacbb15448daec57aaae5a60ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:59.014342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ca1cc777-4cac-4753-b969-e29048320c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:59.132276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1018/2015] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:59.133854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95b9a8-77cb-4c9d-8884-de24c3927732 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:59.156393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:59.215719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95b9a8-77cb-4c9d-8884-de24c3927732 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:59.225770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d734d-a64f-45ba-9ee5-7db70a639ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:59.225770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d734d-a64f-45ba-9ee5-7db70a639ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.225770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d734d-a64f-45ba-9ee5-7db70a639ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.225770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d734d-a64f-45ba-9ee5-7db70a639ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.226069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d734d-a64f-45ba-9ee5-7db70a639ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:59.226069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d734d-a64f-45ba-9ee5-7db70a639ab8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:59.252462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 998/2016] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:42:59 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:42:59.256553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cc777-4cac-4753-b969-e29048320c9a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:59.268644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1cc777-4cac-4753-b969-e29048320c9a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:59.326485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d731a-f526-4652-b3c1-8639f6ba2c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:59.327177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d731a-f526-4652-b3c1-8639f6ba2c27 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.327471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d731a-f526-4652-b3c1-8639f6ba2c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.327810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d731a-f526-4652-b3c1-8639f6ba2c27 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.328528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d731a-f526-4652-b3c1-8639f6ba2c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:59.330445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d731a-f526-4652-b3c1-8639f6ba2c27 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:59.353741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1019/2017] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:42:59 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:42:59.354955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d734d-a64f-45ba-9ee5-7db70a639ab8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:59.365170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d734d-a64f-45ba-9ee5-7db70a639ab8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:59.383869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a25e74-115f-4d9b-adca-e72f2c17fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:59.384995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a25e74-115f-4d9b-adca-e72f2c17fd65 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.384995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a25e74-115f-4d9b-adca-e72f2c17fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.385199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a25e74-115f-4d9b-adca-e72f2c17fd65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.386049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a25e74-115f-4d9b-adca-e72f2c17fd65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:59.388282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a25e74-115f-4d9b-adca-e72f2c17fd65 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:59.406966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 999/2018] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:59.408290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d731a-f526-4652-b3c1-8639f6ba2c27 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:59.419187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d731a-f526-4652-b3c1-8639f6ba2c27 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:59.423972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4fdb5-ec33-4e04-9b35-d1fa59e25a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:59.424963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fdb5-ec33-4e04-9b35-d1fa59e25a68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.425407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fdb5-ec33-4e04-9b35-d1fa59e25a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.425535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4fdb5-ec33-4e04-9b35-d1fa59e25a68 admin admin] PATH_INFO: `/v3/projects/5363259236f74ec58e1b62ba76885eaf/users/9dc50982ec59420585f139c588f7aca2/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.454839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4fdb5-ec33-4e04-9b35-d1fa59e25a68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5363259236f74ec58e1b62ba76885eaf, user_id=9dc50982ec59420585f139c588f7aca2, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:59.457550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d4fdb5-ec33-4e04-9b35-d1fa59e25a68 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:59.476871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1020/2019] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:59 2022] PUT /identity/v3/projects/5363259236f74ec58e1b62ba76885eaf/users/9dc50982ec59420585f139c588f7aca2/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:59.478136 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a25e74-115f-4d9b-adca-e72f2c17fd65 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:59.496260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a25e74-115f-4d9b-adca-e72f2c17fd65 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:59.587218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ba896-8b1d-48d5-981b-320c171a13de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:59.588376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba896-8b1d-48d5-981b-320c171a13de admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.588878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba896-8b1d-48d5-981b-320c171a13de admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.589635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ba896-8b1d-48d5-981b-320c171a13de admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.590599 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ba896-8b1d-48d5-981b-320c171a13de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:59.593233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ba896-8b1d-48d5-981b-320c171a13de admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:59.607650 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1000/2020] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:42:59.609564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4fdb5-ec33-4e04-9b35-d1fa59e25a68 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:59.620518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4fdb5-ec33-4e04-9b35-d1fa59e25a68 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:59.625444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:59.626395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.626751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.627092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] PATH_INFO: `/v3/projects/5363259236f74ec58e1b62ba76885eaf/users/9dc50982ec59420585f139c588f7aca2/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.629264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5363259236f74ec58e1b62ba76885eaf, user_id=9dc50982ec59420585f139c588f7aca2, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:59.632026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:59.658905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1021/2021] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:42:59 2022] PUT /identity/v3/projects/5363259236f74ec58e1b62ba76885eaf/users/9dc50982ec59420585f139c588f7aca2/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:42:59.661475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d85b4-55a7-40b9-b4e1-6f3bfc8b5e3e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.661765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d85b4-55a7-40b9-b4e1-6f3bfc8b5e3e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.662047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d85b4-55a7-40b9-b4e1-6f3bfc8b5e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.697801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-943d85b4-55a7-40b9-b4e1-6f3bfc8b5e3e None None] MFA Rules not processed for user `9dc50982ec59420585f139c588f7aca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:42:59.700653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-943d85b4-55a7-40b9-b4e1-6f3bfc8b5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:59.788190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1001/2022] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:42:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:42:59.800672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:59.802924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:59.854705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:42:59.869861 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35275a65-688d-451f-8724-2cf10ca0cd2c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:59.873472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee0445-95c3-4c69-99d2-59501a800070 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:59.874136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee0445-95c3-4c69-99d2-59501a800070 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.874413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee0445-95c3-4c69-99d2-59501a800070 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.874682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee0445-95c3-4c69-99d2-59501a800070 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.883869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee0445-95c3-4c69-99d2-59501a800070 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:42:59.885354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee0445-95c3-4c69-99d2-59501a800070 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:42:59.894810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1022/2023] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:42:59.966988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d85b4-55a7-40b9-b4e1-6f3bfc8b5e3e None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:42:59.968445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-943d85b4-55a7-40b9-b4e1-6f3bfc8b5e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:42:59.980892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d85b4-55a7-40b9-b4e1-6f3bfc8b5e3e None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:42:59.984719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:42:59.985453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:42:59.985741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:42:59.986070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:42:59.990747 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:00.049322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:00.051219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:00.061326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1002/2024] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:42:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:06.143903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d241a0-fc17-4a06-8966-76ec1b265e09 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:06.143903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d241a0-fc17-4a06-8966-76ec1b265e09 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:06.143903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d241a0-fc17-4a06-8966-76ec1b265e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:06.160964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b5d241a0-fc17-4a06-8966-76ec1b265e09 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:06.162198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b5d241a0-fc17-4a06-8966-76ec1b265e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:06.221424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1023/2025] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:43:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:06.263869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:06.265484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:06.339534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767162c5-4bae-4224-a923-94e16f738423 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:06.345700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb05871-f082-436b-afd1-9e9d2e2d708a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:06.346453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05871-f082-436b-afd1-9e9d2e2d708a service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:06.346683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05871-f082-436b-afd1-9e9d2e2d708a service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:06.346950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb05871-f082-436b-afd1-9e9d2e2d708a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:06.356487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb05871-f082-436b-afd1-9e9d2e2d708a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:06.358118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb05871-f082-436b-afd1-9e9d2e2d708a service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:06.366774 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1003/2026] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:43:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:06.922253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d05a9-e736-41a7-b626-f2041fa21125 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:06.922550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d05a9-e736-41a7-b626-f2041fa21125 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:06.922833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d05a9-e736-41a7-b626-f2041fa21125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:06.940930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-731d05a9-e736-41a7-b626-f2041fa21125 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:06.942167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-731d05a9-e736-41a7-b626-f2041fa21125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:06.949703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1024/2027] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 12 13:43:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:06.962993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb05871-f082-436b-afd1-9e9d2e2d708a service swift] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:06.973601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb05871-f082-436b-afd1-9e9d2e2d708a service swift] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:06.981030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9881b-2fa4-4b1a-b4f8-31d8e7c58ba5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:06.981716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9881b-2fa4-4b1a-b4f8-31d8e7c58ba5 service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:06.982000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9881b-2fa4-4b1a-b4f8-31d8e7c58ba5 service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:06.982278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9881b-2fa4-4b1a-b4f8-31d8e7c58ba5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:06.991372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9881b-2fa4-4b1a-b4f8-31d8e7c58ba5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:06.992945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9881b-2fa4-4b1a-b4f8-31d8e7c58ba5 service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:07.001524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1004/2028] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:43:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:07.237275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d05a9-e736-41a7-b626-f2041fa21125 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:07.272464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043211f-ed02-4427-83e5-38c20e23a1ef None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:07.272995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043211f-ed02-4427-83e5-38c20e23a1ef None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:07.273082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043211f-ed02-4427-83e5-38c20e23a1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:07.294349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7043211f-ed02-4427-83e5-38c20e23a1ef None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:07.296561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7043211f-ed02-4427-83e5-38c20e23a1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:07.307834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d05a9-e736-41a7-b626-f2041fa21125 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:07.308637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1005/2029] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:43:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:07.315395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:07.316693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:07.316981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:07.317259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] PATH_INFO: `/v3/users/0aa16eacbb15448daec57aaae5a60ee5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:07.318520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aa16eacbb15448daec57aaae5a60ee5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:07.321930 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043211f-ed02-4427-83e5-38c20e23a1ef None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:07.322103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:07.334461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043211f-ed02-4427-83e5-38c20e23a1ef None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:07.339512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e71cab-1d5c-4aa1-89f8-51d62ee6977f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:07.340234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71cab-1d5c-4aa1-89f8-51d62ee6977f service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:07.340594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71cab-1d5c-4aa1-89f8-51d62ee6977f service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:07.340873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e71cab-1d5c-4aa1-89f8-51d62ee6977f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:07.349392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e71cab-1d5c-4aa1-89f8-51d62ee6977f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:07.350964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e71cab-1d5c-4aa1-89f8-51d62ee6977f service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:07.360301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1006/2030] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:43:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 13:43:07.375508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aa16eacbb15448daec57aaae5a60ee5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:07.376387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aa16eacbb15448daec57aaae5a60ee5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:07.385388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aa16eacbb15448daec57aaae5a60ee5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:07.393704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aa16eacbb15448daec57aaae5a60ee5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:07.394474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aa16eacbb15448daec57aaae5a60ee5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:07.410112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:07.415050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1025/2031] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:07 2022] DELETE /identity/v3/users/0aa16eacbb15448daec57aaae5a60ee5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:07.420013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812abe89-6058-454a-a499-7c516ff95098 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:07.420457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812abe89-6058-454a-a499-7c516ff95098 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:07.420880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812abe89-6058-454a-a499-7c516ff95098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:07.440085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-812abe89-6058-454a-a499-7c516ff95098 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:07.441791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-812abe89-6058-454a-a499-7c516ff95098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:07.508495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1007/2032] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:07.518240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:07.519684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:07.581071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e43a54-317d-4068-9fd3-cceaf47d8a27 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:07.584971 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:07.585627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:07.585907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:07.586183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:07.595887 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:07.597382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:07.608989 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1026/2033] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:07.737972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661dbf-8f52-4601-9f03-c1cc8a58f878 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:07.738231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661dbf-8f52-4601-9f03-c1cc8a58f878 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:07.738529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9661dbf-8f52-4601-9f03-c1cc8a58f878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:07.745635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:07.762297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-c9661dbf-8f52-4601-9f03-c1cc8a58f878 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:07.763452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c9661dbf-8f52-4601-9f03-c1cc8a58f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:07.825185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1008/2034] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 12 13:43:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:07.837417 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:07.838885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:07.915219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ccee1-f89d-4f9e-b0a7-9afd61618d76 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:07.925146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe353ebc-32ed-4a47-98ef-93e07fca5d75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:07.925815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353ebc-32ed-4a47-98ef-93e07fca5d75 service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:07.926189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353ebc-32ed-4a47-98ef-93e07fca5d75 service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:07.926372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe353ebc-32ed-4a47-98ef-93e07fca5d75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:07.935661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe353ebc-32ed-4a47-98ef-93e07fca5d75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:07.937757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe353ebc-32ed-4a47-98ef-93e07fca5d75 service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:07.955851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1027/2035] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:43:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:08.125916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661dbf-8f52-4601-9f03-c1cc8a58f878 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:08.127345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c9661dbf-8f52-4601-9f03-c1cc8a58f878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:08.146552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9661dbf-8f52-4601-9f03-c1cc8a58f878 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:08.156608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:08.156608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:08.156608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:08.156608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] PATH_INFO: `/v3/projects/5b402dc451244e26b55dadafc28c835e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:08.157665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b402dc451244e26b55dadafc28c835e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:08.161036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:08.233585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b402dc451244e26b55dadafc28c835e', 'request_id': 'req-578d2289-130d-49f6-810c-8b86f50bf7fd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.247959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b402dc451244e26b55dadafc28c835e', 'request_id': 'req-578d2289-130d-49f6-810c-8b86f50bf7fd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.263150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b402dc451244e26b55dadafc28c835e', 'request_id': 'req-578d2289-130d-49f6-810c-8b86f50bf7fd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.278088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] The token cache is being invalidate because project 5b402dc451244e26b55dadafc28c835e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:08.278678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.279233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.282296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1009/2036] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:08 2022] DELETE /identity/v3/projects/5b402dc451244e26b55dadafc28c835e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:08.288650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe353ebc-32ed-4a47-98ef-93e07fca5d75 service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:08.312265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe353ebc-32ed-4a47-98ef-93e07fca5d75 service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:08.394342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:08.394873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:08.395155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:08.395530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] PATH_INFO: `/v3/users/9dc50982ec59420585f139c588f7aca2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:08.396836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc50982ec59420585f139c588f7aca2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:08.398746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:08.450725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:08.475060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc50982ec59420585f139c588f7aca2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.475936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc50982ec59420585f139c588f7aca2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.485577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc50982ec59420585f139c588f7aca2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.494299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc50982ec59420585f139c588f7aca2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.494982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-99018f8a-0a8a-4199-a46e-a8731519a897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc50982ec59420585f139c588f7aca2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:08.512426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1028/2037] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:08 2022] DELETE /identity/v3/users/9dc50982ec59420585f139c588f7aca2 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:08.819337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:08.821171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:08.845296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d2289-130d-49f6-810c-8b86f50bf7fd admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:08.916451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:08.916451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:08.916451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:08.916901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] PATH_INFO: `/v3/projects/5363259236f74ec58e1b62ba76885eaf` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:08.918154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5363259236f74ec58e1b62ba76885eaf)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:08.922011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:08.984587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:09.005463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5363259236f74ec58e1b62ba76885eaf', 'request_id': 'req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:09.015050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5363259236f74ec58e1b62ba76885eaf', 'request_id': 'req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:09.030065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5363259236f74ec58e1b62ba76885eaf', 'request_id': 'req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:09.044318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] The token cache is being invalidate because project 5363259236f74ec58e1b62ba76885eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:09.044617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:09.045287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9e9fa233-ec7a-4fc3-b1b6-84f8660f23f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:09.051498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1010/2038] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:08 2022] DELETE /identity/v3/projects/5363259236f74ec58e1b62ba76885eaf => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:09.053164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02173f17-c494-48ec-ac76-250962efef25 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.053647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02173f17-c494-48ec-ac76-250962efef25 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.053933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02173f17-c494-48ec-ac76-250962efef25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.076376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-02173f17-c494-48ec-ac76-250962efef25 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:09.077767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-02173f17-c494-48ec-ac76-250962efef25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:09.149162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1029/2039] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:09.157366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e253ed8-f2e9-4853-ae8e-5fe6bfc062f8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.157709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e253ed8-f2e9-4853-ae8e-5fe6bfc062f8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.157991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e253ed8-f2e9-4853-ae8e-5fe6bfc062f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.176107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5e253ed8-f2e9-4853-ae8e-5fe6bfc062f8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:09.177322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5e253ed8-f2e9-4853-ae8e-5fe6bfc062f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:09.185161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1011/2040] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:09.189580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02173f17-c494-48ec-ac76-250962efef25 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.199811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02173f17-c494-48ec-ac76-250962efef25 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.204381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.205040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.205322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.205593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.206327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:43:09.206631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.208356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.220012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1030/2041] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:43:09.224864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e253ed8-f2e9-4853-ae8e-5fe6bfc062f8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.235716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e253ed8-f2e9-4853-ae8e-5fe6bfc062f8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.241322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1429e1-bb40-459e-bca4-718868ff19ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.241986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1429e1-bb40-459e-bca4-718868ff19ad admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.242272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1429e1-bb40-459e-bca4-718868ff19ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.242551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1429e1-bb40-459e-bca4-718868ff19ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.243249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1429e1-bb40-459e-bca4-718868ff19ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.245200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1429e1-bb40-459e-bca4-718868ff19ad admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.274857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1012/2042] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:43:09 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:09.279140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.289834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b29837-9390-4608-8c81-f4c5238eace1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.346712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d8459-60e2-435c-9b2e-2fa0eb9b6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.347385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d8459-60e2-435c-9b2e-2fa0eb9b6cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.347697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d8459-60e2-435c-9b2e-2fa0eb9b6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.347969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d8459-60e2-435c-9b2e-2fa0eb9b6cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.348666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d8459-60e2-435c-9b2e-2fa0eb9b6cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.350581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1d8459-60e2-435c-9b2e-2fa0eb9b6cf3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.377242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1031/2043] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:43:09 2022] POST /identity/v3/users => generated 278 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:43:09.378419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1429e1-bb40-459e-bca4-718868ff19ad admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.390763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1429e1-bb40-459e-bca4-718868ff19ad admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.396859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429164d-fa02-4748-b865-a3c99dc54263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.397570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429164d-fa02-4748-b865-a3c99dc54263 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.397855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429164d-fa02-4748-b865-a3c99dc54263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.398128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a429164d-fa02-4748-b865-a3c99dc54263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.398864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429164d-fa02-4748-b865-a3c99dc54263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.406559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a429164d-fa02-4748-b865-a3c99dc54263 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.418968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1013/2044] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:43:09.423414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d8459-60e2-435c-9b2e-2fa0eb9b6cf3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.435629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1d8459-60e2-435c-9b2e-2fa0eb9b6cf3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.441801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23581c5f-e93f-4e34-92cb-d9c13a1d0d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.442838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c5f-e93f-4e34-92cb-d9c13a1d0d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.443120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c5f-e93f-4e34-92cb-d9c13a1d0d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.443579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23581c5f-e93f-4e34-92cb-d9c13a1d0d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.444416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581c5f-e93f-4e34-92cb-d9c13a1d0d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.446377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23581c5f-e93f-4e34-92cb-d9c13a1d0d13 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.464330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1032/2045] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:09.466308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429164d-fa02-4748-b865-a3c99dc54263 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.477401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a429164d-fa02-4748-b865-a3c99dc54263 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.484279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4054726-e6cc-434c-b2b0-89fc9a79895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.485187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4054726-e6cc-434c-b2b0-89fc9a79895a admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.485812 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4054726-e6cc-434c-b2b0-89fc9a79895a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.486101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4054726-e6cc-434c-b2b0-89fc9a79895a admin admin] PATH_INFO: `/v3/projects/3f11cd728b69431a972a6b4bb32cf5fe/users/89b723de155a46dd8c7a914ce2f88948/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.503514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4054726-e6cc-434c-b2b0-89fc9a79895a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f11cd728b69431a972a6b4bb32cf5fe, user_id=89b723de155a46dd8c7a914ce2f88948, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.506206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4054726-e6cc-434c-b2b0-89fc9a79895a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.522363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1014/2046] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:09 2022] PUT /identity/v3/projects/3f11cd728b69431a972a6b4bb32cf5fe/users/89b723de155a46dd8c7a914ce2f88948/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:09.534848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370033-47f5-4cb3-bfe4-fbd39fb483a2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.535188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370033-47f5-4cb3-bfe4-fbd39fb483a2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.535470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a370033-47f5-4cb3-bfe4-fbd39fb483a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.566384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7a370033-47f5-4cb3-bfe4-fbd39fb483a2 None None] MFA Rules not processed for user `89b723de155a46dd8c7a914ce2f88948`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:09.567814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7a370033-47f5-4cb3-bfe4-fbd39fb483a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:09.573141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:09.640524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1033/2047] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:09 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:09.648442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4054726-e6cc-434c-b2b0-89fc9a79895a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.715160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4054726-e6cc-434c-b2b0-89fc9a79895a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.719898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e628-0a67-4dd5-bb6b-410368f49ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.720568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e628-0a67-4dd5-bb6b-410368f49ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.721277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e628-0a67-4dd5-bb6b-410368f49ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.721277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298e628-0a67-4dd5-bb6b-410368f49ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.721838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e628-0a67-4dd5-bb6b-410368f49ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.723719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298e628-0a67-4dd5-bb6b-410368f49ff8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.751190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1015/2048] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:43:09 2022] POST /identity/v3/projects => generated 357 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:09.755322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a370033-47f5-4cb3-bfe4-fbd39fb483a2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.766962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a370033-47f5-4cb3-bfe4-fbd39fb483a2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.827032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0b176-e124-445c-b723-0759ad3c8e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.827739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b176-e124-445c-b723-0759ad3c8e88 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.828019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b176-e124-445c-b723-0759ad3c8e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.828291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b176-e124-445c-b723-0759ad3c8e88 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.828985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0b176-e124-445c-b723-0759ad3c8e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.830902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0b176-e124-445c-b723-0759ad3c8e88 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.851727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1034/2049] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:43:09 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:09.855853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e628-0a67-4dd5-bb6b-410368f49ff8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.869121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298e628-0a67-4dd5-bb6b-410368f49ff8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.878086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caba0b2-939c-4014-a804-177675671680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.878883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caba0b2-939c-4014-a804-177675671680 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.879173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caba0b2-939c-4014-a804-177675671680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.879453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caba0b2-939c-4014-a804-177675671680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.880226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caba0b2-939c-4014-a804-177675671680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.881825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caba0b2-939c-4014-a804-177675671680 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.893096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1016/2050] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:43:09.897703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0b176-e124-445c-b723-0759ad3c8e88 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.908658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0b176-e124-445c-b723-0759ad3c8e88 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:09.914585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfdaa4-77a9-4b44-9c5b-383abb5551f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:09.915705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfdaa4-77a9-4b44-9c5b-383abb5551f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:09.916004 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfdaa4-77a9-4b44-9c5b-383abb5551f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:09.916258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfdaa4-77a9-4b44-9c5b-383abb5551f5 admin admin] PATH_INFO: `/v3/projects/bd7d07cf4c6b42af962b0d1991d2ed43/users/2e646645fef74253a02f1178157af8bd/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:09.931119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfdaa4-77a9-4b44-9c5b-383abb5551f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7d07cf4c6b42af962b0d1991d2ed43, user_id=2e646645fef74253a02f1178157af8bd, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:09.934181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfdaa4-77a9-4b44-9c5b-383abb5551f5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:09.949543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1035/2051] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:09 2022] PUT /identity/v3/projects/bd7d07cf4c6b42af962b0d1991d2ed43/users/2e646645fef74253a02f1178157af8bd/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:09.956873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caba0b2-939c-4014-a804-177675671680 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:09.967373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caba0b2-939c-4014-a804-177675671680 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:10.010933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:10.041006 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2f9f-ef3b-4d04-b702-8634175af137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:10.041694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f9f-ef3b-4d04-b702-8634175af137 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.041977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f9f-ef3b-4d04-b702-8634175af137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.042253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2f9f-ef3b-4d04-b702-8634175af137 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.042997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c2f9f-ef3b-4d04-b702-8634175af137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:10.044639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c2f9f-ef3b-4d04-b702-8634175af137 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:10.055500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1017/2052] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:10.059953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfdaa4-77a9-4b44-9c5b-383abb5551f5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:10.071090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfdaa4-77a9-4b44-9c5b-383abb5551f5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:10.076393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:10.077323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.077596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.077867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] PATH_INFO: `/v3/projects/bd7d07cf4c6b42af962b0d1991d2ed43/users/2e646645fef74253a02f1178157af8bd/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.079982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd7d07cf4c6b42af962b0d1991d2ed43, user_id=2e646645fef74253a02f1178157af8bd, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:10.082642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:10.093883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1036/2053] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:10 2022] PUT /identity/v3/projects/bd7d07cf4c6b42af962b0d1991d2ed43/users/2e646645fef74253a02f1178157af8bd/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:10.105383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439bca5-80d1-4059-bbfd-2781085fb926 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.105705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439bca5-80d1-4059-bbfd-2781085fb926 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.106338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439bca5-80d1-4059-bbfd-2781085fb926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.134964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e439bca5-80d1-4059-bbfd-2781085fb926 None None] MFA Rules not processed for user `2e646645fef74253a02f1178157af8bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:10.136124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e439bca5-80d1-4059-bbfd-2781085fb926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:10.188240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:10.190168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:10.209084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1018/2054] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:10 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:10.223091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439bca5-80d1-4059-bbfd-2781085fb926 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:10.224556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e439bca5-80d1-4059-bbfd-2781085fb926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:10.259832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e5264-1130-466a-b7dc-9d1283547942 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:10.264913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:10.265819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.266099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.266376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] PATH_INFO: `/v3/users/e885bb7e601e4ef49a06cfe1170150d5` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.267657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e885bb7e601e4ef49a06cfe1170150d5)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:10.269630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:10.271703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:10.283258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439bca5-80d1-4059-bbfd-2781085fb926 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:10.286943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4bf723-26e7-46a9-8686-89c87cffdccc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:10.287655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bf723-26e7-46a9-8686-89c87cffdccc service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.287963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bf723-26e7-46a9-8686-89c87cffdccc service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.288238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4bf723-26e7-46a9-8686-89c87cffdccc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.298970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bf723-26e7-46a9-8686-89c87cffdccc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:10.300712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4bf723-26e7-46a9-8686-89c87cffdccc service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:10.312870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1019/2055] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:10 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:10.322515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e885bb7e601e4ef49a06cfe1170150d5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:10.323175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e885bb7e601e4ef49a06cfe1170150d5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:10.332862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e885bb7e601e4ef49a06cfe1170150d5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:10.339894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e885bb7e601e4ef49a06cfe1170150d5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:10.340550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e885bb7e601e4ef49a06cfe1170150d5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:10.363105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1037/2056] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:10 2022] DELETE /identity/v3/users/e885bb7e601e4ef49a06cfe1170150d5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:10.367525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041354b-7981-4a54-92fe-66159408a28b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.367865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041354b-7981-4a54-92fe-66159408a28b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.368172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0041354b-7981-4a54-92fe-66159408a28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.386873 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0041354b-7981-4a54-92fe-66159408a28b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:10.387455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:10.388047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0041354b-7981-4a54-92fe-66159408a28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:10.388979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:10.437782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:10.448992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0ff8d-ec63-449f-b12b-82136805c185 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:10.454672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1020/2057] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:10.454833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:10.454833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.454833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.455763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.457349 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:10.461585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041354b-7981-4a54-92fe-66159408a28b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:10.463126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0041354b-7981-4a54-92fe-66159408a28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:10.521867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:10.523305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:10.524042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0041354b-7981-4a54-92fe-66159408a28b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:10.527766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a1734-87db-4723-81de-775d4923cf57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:10.528423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a1734-87db-4723-81de-775d4923cf57 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.528704 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a1734-87db-4723-81de-775d4923cf57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.528968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a1734-87db-4723-81de-775d4923cf57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.532307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1038/2058] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:10 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:43:10.542845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a1734-87db-4723-81de-775d4923cf57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:10.545434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a1734-87db-4723-81de-775d4923cf57 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:10.558053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1021/2059] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:43:10.880127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:10.881820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:10.911184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d3978-1a1a-4ad0-85da-ac02e81b5071 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:10.918713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:10.919560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:10.919885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:10.920127 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] PATH_INFO: `/v3/projects/c16e9de9af264550a8fba1e0d00577cd` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:10.921596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16e9de9af264550a8fba1e0d00577cd)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:10.923620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:10.962574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:10.980738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16e9de9af264550a8fba1e0d00577cd', 'request_id': 'req-c495ec6b-7f88-44a4-a815-9b1686c95c6a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:10.987374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16e9de9af264550a8fba1e0d00577cd', 'request_id': 'req-c495ec6b-7f88-44a4-a815-9b1686c95c6a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:10.997789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16e9de9af264550a8fba1e0d00577cd', 'request_id': 'req-c495ec6b-7f88-44a4-a815-9b1686c95c6a'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:11.008705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] The token cache is being invalidate because project c16e9de9af264550a8fba1e0d00577cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:11.009022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:11.009693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:11.011262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1039/2060] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:10 2022] DELETE /identity/v3/projects/c16e9de9af264550a8fba1e0d00577cd => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:18.505690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392166d4-e061-4031-89ba-bf3a807e1b2b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:18.506238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392166d4-e061-4031-89ba-bf3a807e1b2b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:18.506238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392166d4-e061-4031-89ba-bf3a807e1b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:18.525307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-392166d4-e061-4031-89ba-bf3a807e1b2b None None] MFA Rules not processed for user `9ace3acc926b4b5580ff15a060c040ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:18.526561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-392166d4-e061-4031-89ba-bf3a807e1b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:18.584211 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1022/2061] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:21.005535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=14,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:25.693450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:25.695148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:25.762682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c495ec6b-7f88-44a4-a815-9b1686c95c6a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:25.767927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:25.768809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:25.769087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:25.769361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] PATH_INFO: `/v3/users/89b723de155a46dd8c7a914ce2f88948` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:25.770578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89b723de155a46dd8c7a914ce2f88948)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:25.772551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:25.825163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89b723de155a46dd8c7a914ce2f88948'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:25.825837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89b723de155a46dd8c7a914ce2f88948'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:25.833302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89b723de155a46dd8c7a914ce2f88948'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:25.840809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89b723de155a46dd8c7a914ce2f88948'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:25.841545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89b723de155a46dd8c7a914ce2f88948'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:25.859210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1040/2062] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:25 2022] DELETE /identity/v3/users/89b723de155a46dd8c7a914ce2f88948 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:25.863876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668ee9-c163-4245-aedd-09233fe7218f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:25.864382 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668ee9-c163-4245-aedd-09233fe7218f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:25.864477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1668ee9-c163-4245-aedd-09233fe7218f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:25.882602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e1668ee9-c163-4245-aedd-09233fe7218f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:25.883853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e1668ee9-c163-4245-aedd-09233fe7218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:25.951241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1023/2063] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:25.961548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:25.964038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:26.025656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557e1b6-ed56-4677-804f-1dbef9e0362e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:26.029723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d7a62-a67d-403b-abd8-9cad6b1510de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:26.030378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d7a62-a67d-403b-abd8-9cad6b1510de service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:26.030662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d7a62-a67d-403b-abd8-9cad6b1510de service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:26.030939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d7a62-a67d-403b-abd8-9cad6b1510de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:26.040256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d7a62-a67d-403b-abd8-9cad6b1510de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:26.041717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d7a62-a67d-403b-abd8-9cad6b1510de service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:26.051179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1041/2064] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:26.381031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1668ee9-c163-4245-aedd-09233fe7218f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:26.382607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e1668ee9-c163-4245-aedd-09233fe7218f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:26.395098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1668ee9-c163-4245-aedd-09233fe7218f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:26.399733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:26.400623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:26.400907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:26.401186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] PATH_INFO: `/v3/projects/3f11cd728b69431a972a6b4bb32cf5fe` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:26.402385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f11cd728b69431a972a6b4bb32cf5fe)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:26.404325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:26.456910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:26.464993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f11cd728b69431a972a6b4bb32cf5fe', 'request_id': 'req-150955a5-b865-4789-848e-5030d5247897'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.472011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f11cd728b69431a972a6b4bb32cf5fe', 'request_id': 'req-150955a5-b865-4789-848e-5030d5247897'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.477425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f11cd728b69431a972a6b4bb32cf5fe', 'request_id': 'req-150955a5-b865-4789-848e-5030d5247897'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.488395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] The token cache is being invalidate because project 3f11cd728b69431a972a6b4bb32cf5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:26.488686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.489304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.490868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1024/2065] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:26 2022] DELETE /identity/v3/projects/3f11cd728b69431a972a6b4bb32cf5fe => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:26.494909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d7a62-a67d-403b-abd8-9cad6b1510de service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:26.504598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d7a62-a67d-403b-abd8-9cad6b1510de service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:26.523835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:26.564371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:26.565269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:26.565555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:26.565834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] PATH_INFO: `/v3/users/2e646645fef74253a02f1178157af8bd` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:26.567503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e646645fef74253a02f1178157af8bd)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:26.569486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:26.632726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e646645fef74253a02f1178157af8bd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.633570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e646645fef74253a02f1178157af8bd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.642751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e646645fef74253a02f1178157af8bd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.649726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e646645fef74253a02f1178157af8bd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.650411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00af43e3-5270-4e10-ae26-daa6bdc5f699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e646645fef74253a02f1178157af8bd'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:26.667843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1042/2066] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:26 2022] DELETE /identity/v3/users/2e646645fef74253a02f1178157af8bd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:27.018751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.020398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:27.033444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150955a5-b865-4789-848e-5030d5247897 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.092401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.093499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.093999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.094493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] PATH_INFO: `/v3/projects/bd7d07cf4c6b42af962b0d1991d2ed43` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.096305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd7d07cf4c6b42af962b0d1991d2ed43)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.098257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:27.156663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd7d07cf4c6b42af962b0d1991d2ed43', 'request_id': 'req-a717630a-f368-4a80-bd18-c0b3884106e9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:27.166347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd7d07cf4c6b42af962b0d1991d2ed43', 'request_id': 'req-a717630a-f368-4a80-bd18-c0b3884106e9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:27.174577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd7d07cf4c6b42af962b0d1991d2ed43', 'request_id': 'req-a717630a-f368-4a80-bd18-c0b3884106e9'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:27.186522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] The token cache is being invalidate because project bd7d07cf4c6b42af962b0d1991d2ed43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:27.186801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:27.187678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a717630a-f368-4a80-bd18-c0b3884106e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:27.189165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1025/2067] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:27 2022] DELETE /identity/v3/projects/bd7d07cf4c6b42af962b0d1991d2ed43 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:27.194508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2485f-3c5a-4c13-867c-f6856296a368 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.194992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2485f-3c5a-4c13-867c-f6856296a368 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.195082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2485f-3c5a-4c13-867c-f6856296a368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.213776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-30a2485f-3c5a-4c13-867c-f6856296a368 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:27.215029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-30a2485f-3c5a-4c13-867c-f6856296a368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:27.273848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1043/2068] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:27.283137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d90426-c437-4265-a22c-79d39ef5eb14 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.283424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d90426-c437-4265-a22c-79d39ef5eb14 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.283727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d90426-c437-4265-a22c-79d39ef5eb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.313655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e8d90426-c437-4265-a22c-79d39ef5eb14 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:27.315221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e8d90426-c437-4265-a22c-79d39ef5eb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:27.324768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1026/2069] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:27.328899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2485f-3c5a-4c13-867c-f6856296a368 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.339053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2485f-3c5a-4c13-867c-f6856296a368 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.344009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.344679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.344962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.345257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.345977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:43:27.346342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.348022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:27.361370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1044/2070] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:43:27.365742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d90426-c437-4265-a22c-79d39ef5eb14 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.376501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d90426-c437-4265-a22c-79d39ef5eb14 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.382863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9e75-6144-4d39-82fe-9f1bc1ac96af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.383010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9e75-6144-4d39-82fe-9f1bc1ac96af admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.383779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9e75-6144-4d39-82fe-9f1bc1ac96af admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.384269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9e75-6144-4d39-82fe-9f1bc1ac96af admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.385004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f9e75-6144-4d39-82fe-9f1bc1ac96af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.386971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f9e75-6144-4d39-82fe-9f1bc1ac96af admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:27.423063 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1027/2071] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:43:27 2022] POST /identity/v3/projects => generated 361 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:27.424739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.436465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f287bdd8-2f1b-4b19-95b0-b12f812a234d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.470420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:27.520876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296542e-5642-4dda-ade7-600d62177a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.521679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296542e-5642-4dda-ade7-600d62177a78 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.522084 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296542e-5642-4dda-ade7-600d62177a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.522460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296542e-5642-4dda-ade7-600d62177a78 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.523265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296542e-5642-4dda-ade7-600d62177a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.525469 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296542e-5642-4dda-ade7-600d62177a78 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:27.551288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1045/2072] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:43:27 2022] POST /identity/v3/users => generated 281 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:43:27.552526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9e75-6144-4d39-82fe-9f1bc1ac96af admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.564441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9e75-6144-4d39-82fe-9f1bc1ac96af admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.570081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5439-d0e1-48c4-8db3-6b94c10c1d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.570779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5439-d0e1-48c4-8db3-6b94c10c1d56 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.571171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5439-d0e1-48c4-8db3-6b94c10c1d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.571484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a5439-d0e1-48c4-8db3-6b94c10c1d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.572263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5439-d0e1-48c4-8db3-6b94c10c1d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.573894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a5439-d0e1-48c4-8db3-6b94c10c1d56 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:27.587931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1028/2073] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:43:27.592399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296542e-5642-4dda-ade7-600d62177a78 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.603245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296542e-5642-4dda-ade7-600d62177a78 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.608157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0253f-6f12-402a-b35c-38f63f3bfa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.609179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0253f-6f12-402a-b35c-38f63f3bfa91 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.609465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0253f-6f12-402a-b35c-38f63f3bfa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.609740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0253f-6f12-402a-b35c-38f63f3bfa91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.610480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0253f-6f12-402a-b35c-38f63f3bfa91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.612107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0253f-6f12-402a-b35c-38f63f3bfa91 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:27.626002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1046/2074] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:43:27.627303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5439-d0e1-48c4-8db3-6b94c10c1d56 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.638117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a5439-d0e1-48c4-8db3-6b94c10c1d56 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.642858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d1d1-8465-41a1-94f4-772fd76257af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.643780 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d1d1-8465-41a1-94f4-772fd76257af admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.644060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d1d1-8465-41a1-94f4-772fd76257af admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.644341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5d1d1-8465-41a1-94f4-772fd76257af admin admin] PATH_INFO: `/v3/projects/3d8c7ee688b74cbca79abe62dd2321fe/users/144d40f3b334494c80c08c6cce62daa2/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.662480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d1d1-8465-41a1-94f4-772fd76257af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8c7ee688b74cbca79abe62dd2321fe, user_id=144d40f3b334494c80c08c6cce62daa2, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.665262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5d1d1-8465-41a1-94f4-772fd76257af admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:27.667734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:27.680198 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1029/2075] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:27 2022] PUT /identity/v3/projects/3d8c7ee688b74cbca79abe62dd2321fe/users/144d40f3b334494c80c08c6cce62daa2/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:27.690411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514c19-9ccb-405d-93e5-a900e7bae7bc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.690706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514c19-9ccb-405d-93e5-a900e7bae7bc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.691308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee514c19-9ccb-405d-93e5-a900e7bae7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.718968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ee514c19-9ccb-405d-93e5-a900e7bae7bc None None] MFA Rules not processed for user `144d40f3b334494c80c08c6cce62daa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:27.720221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ee514c19-9ccb-405d-93e5-a900e7bae7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:27.789475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1047/2076] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:27.794076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d1d1-8465-41a1-94f4-772fd76257af admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.860147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5d1d1-8465-41a1-94f4-772fd76257af admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.865228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320be5cc-753b-4a62-ad96-41fe9c5c7152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.865892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320be5cc-753b-4a62-ad96-41fe9c5c7152 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.866207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320be5cc-753b-4a62-ad96-41fe9c5c7152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.866480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320be5cc-753b-4a62-ad96-41fe9c5c7152 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.867150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320be5cc-753b-4a62-ad96-41fe9c5c7152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.869092 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320be5cc-753b-4a62-ad96-41fe9c5c7152 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:27.896295 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1030/2077] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:43:27 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:27.901019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514c19-9ccb-405d-93e5-a900e7bae7bc None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:27.916833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee514c19-9ccb-405d-93e5-a900e7bae7bc None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:27.975902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ce738-8854-42d1-941f-eaf213f86cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:27.976598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce738-8854-42d1-941f-eaf213f86cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:27.976914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce738-8854-42d1-941f-eaf213f86cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:27.977219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ce738-8854-42d1-941f-eaf213f86cc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:27.978185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ce738-8854-42d1-941f-eaf213f86cc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:27.980486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ce738-8854-42d1-941f-eaf213f86cc0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:28.002834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1048/2078] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:43:27 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:43:28.006904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320be5cc-753b-4a62-ad96-41fe9c5c7152 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:28.018044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320be5cc-753b-4a62-ad96-41fe9c5c7152 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:28.023250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ccbd1-7891-4c8d-8472-b9d355af68ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:28.023964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ccbd1-7891-4c8d-8472-b9d355af68ee admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:28.024254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ccbd1-7891-4c8d-8472-b9d355af68ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:28.024531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ccbd1-7891-4c8d-8472-b9d355af68ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:28.025280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ccbd1-7891-4c8d-8472-b9d355af68ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:28.026898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ccbd1-7891-4c8d-8472-b9d355af68ee admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:28.038632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1031/2079] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:28.043049 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ce738-8854-42d1-941f-eaf213f86cc0 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:28.053515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ce738-8854-42d1-941f-eaf213f86cc0 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:28.059365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c86fe-82f4-443b-bfd7-dbd70bd33e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:28.060293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c86fe-82f4-443b-bfd7-dbd70bd33e5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:28.060575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c86fe-82f4-443b-bfd7-dbd70bd33e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:28.060851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c86fe-82f4-443b-bfd7-dbd70bd33e5e admin admin] PATH_INFO: `/v3/projects/00a70c597fa44fe28e1487584d320923/users/7d77dbc3fa0f4e8f9b9740ea342d6434/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:28.077296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c86fe-82f4-443b-bfd7-dbd70bd33e5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a70c597fa44fe28e1487584d320923, user_id=7d77dbc3fa0f4e8f9b9740ea342d6434, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:28.080026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c86fe-82f4-443b-bfd7-dbd70bd33e5e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:28.094953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1049/2080] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:28 2022] PUT /identity/v3/projects/00a70c597fa44fe28e1487584d320923/users/7d77dbc3fa0f4e8f9b9740ea342d6434/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:43:28.099953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ccbd1-7891-4c8d-8472-b9d355af68ee admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:28.111514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ccbd1-7891-4c8d-8472-b9d355af68ee admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:28.177641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a3cf02-4098-4421-857c-05e0c52de809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:28.178325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3cf02-4098-4421-857c-05e0c52de809 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:28.178603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3cf02-4098-4421-857c-05e0c52de809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:28.178876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a3cf02-4098-4421-857c-05e0c52de809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:28.179608 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3cf02-4098-4421-857c-05e0c52de809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:28.181307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a3cf02-4098-4421-857c-05e0c52de809 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:28.192415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1032/2081] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:28.196611 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c86fe-82f4-443b-bfd7-dbd70bd33e5e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:28.202297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:28.208021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c86fe-82f4-443b-bfd7-dbd70bd33e5e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:28.214429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:28.214988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:28.215267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:28.215540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] PATH_INFO: `/v3/projects/00a70c597fa44fe28e1487584d320923/users/7d77dbc3fa0f4e8f9b9740ea342d6434/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:28.217745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a70c597fa44fe28e1487584d320923, user_id=7d77dbc3fa0f4e8f9b9740ea342d6434, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:28.220427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:28.231205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1050/2082] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:28 2022] PUT /identity/v3/projects/00a70c597fa44fe28e1487584d320923/users/7d77dbc3fa0f4e8f9b9740ea342d6434/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:28.242293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbda3c9-5abd-4d42-8d99-3f0aeec53f15 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:28.242585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbda3c9-5abd-4d42-8d99-3f0aeec53f15 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:28.242866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbda3c9-5abd-4d42-8d99-3f0aeec53f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:28.269994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-cdbda3c9-5abd-4d42-8d99-3f0aeec53f15 None None] MFA Rules not processed for user `7d77dbc3fa0f4e8f9b9740ea342d6434`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:28.271233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cdbda3c9-5abd-4d42-8d99-3f0aeec53f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:28.321966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:28.343263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1033/2083] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:28 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:28.354792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:28.356554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:28.416676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3306901-65d1-4c21-b11d-edc2f88f945d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:28.420990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138474e8-61de-47e1-a370-755f65b3da51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:28.421637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138474e8-61de-47e1-a370-755f65b3da51 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:28.421916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138474e8-61de-47e1-a370-755f65b3da51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:28.422185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138474e8-61de-47e1-a370-755f65b3da51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:28.432307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138474e8-61de-47e1-a370-755f65b3da51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:28.433945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138474e8-61de-47e1-a370-755f65b3da51 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:28.444236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1051/2084] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:28 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:28.517337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbda3c9-5abd-4d42-8d99-3f0aeec53f15 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:28.528071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbda3c9-5abd-4d42-8d99-3f0aeec53f15 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:28.531740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c0d51-500d-413c-a4e6-cc1477fd7c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:28.532396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0d51-500d-413c-a4e6-cc1477fd7c52 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:28.532684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0d51-500d-413c-a4e6-cc1477fd7c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:28.532961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0d51-500d-413c-a4e6-cc1477fd7c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:28.596404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c0d51-500d-413c-a4e6-cc1477fd7c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:28.597769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c0d51-500d-413c-a4e6-cc1477fd7c52 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:28.608535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1034/2085] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:35.708781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138474e8-61de-47e1-a370-755f65b3da51 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:35.761768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dfcc-863e-4e8c-bf62-fe7c65dfa16e None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:35.762264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dfcc-863e-4e8c-bf62-fe7c65dfa16e None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:35.762264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510dfcc-863e-4e8c-bf62-fe7c65dfa16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:35.774939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138474e8-61de-47e1-a370-755f65b3da51 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:35.780784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-2510dfcc-863e-4e8c-bf62-fe7c65dfa16e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:35.781652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:35.781995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2510dfcc-863e-4e8c-bf62-fe7c65dfa16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:35.782600 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:35.782890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:35.783164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] PATH_INFO: `/v3/users/144d40f3b334494c80c08c6cce62daa2` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:35.784504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=144d40f3b334494c80c08c6cce62daa2)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:35.786490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:35.790637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1035/2086] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:35.811569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510dfcc-863e-4e8c-bf62-fe7c65dfa16e None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:35.813109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2510dfcc-863e-4e8c-bf62-fe7c65dfa16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:35.838644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144d40f3b334494c80c08c6cce62daa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:35.839420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144d40f3b334494c80c08c6cce62daa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:35.847849 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144d40f3b334494c80c08c6cce62daa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:35.855419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144d40f3b334494c80c08c6cce62daa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:35.856083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e37abb36-3865-4b8b-9712-8b276484e239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144d40f3b334494c80c08c6cce62daa2'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:35.874455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1052/2087] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:35 2022] DELETE /identity/v3/users/144d40f3b334494c80c08c6cce62daa2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:35.879061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72e0f-608a-495c-a534-e947995938d1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:35.879425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72e0f-608a-495c-a534-e947995938d1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:35.879877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72e0f-608a-495c-a534-e947995938d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:35.890324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510dfcc-863e-4e8c-bf62-fe7c65dfa16e None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:35.897514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-59e72e0f-608a-495c-a534-e947995938d1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:35.898723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-59e72e0f-608a-495c-a534-e947995938d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:35.903751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:35.955836 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:35.956510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:35.956796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:35.957096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:35.958992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:35.964745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1053/2088] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:35.971476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e72e0f-608a-495c-a534-e947995938d1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:35.972412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:35.973041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-59e72e0f-608a-495c-a534-e947995938d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:35.974383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:35.985660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1036/2089] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:36.028574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e72e0f-608a-495c-a534-e947995938d1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:36.032931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2c6d-65f2-4327-9bca-cb6135fee785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:36.033662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2c6d-65f2-4327-9bca-cb6135fee785 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:36.033941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2c6d-65f2-4327-9bca-cb6135fee785 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:36.034216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2c6d-65f2-4327-9bca-cb6135fee785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:36.044072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b2c6d-65f2-4327-9bca-cb6135fee785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:36.045504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b2c6d-65f2-4327-9bca-cb6135fee785 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:36.055231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1054/2090] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:36.349129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:36.350718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:36.359581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:36.363706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef689b-a071-473d-b1d8-f625b7ffdfe4 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:36.369407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:36.370358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:36.370677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:36.370975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] PATH_INFO: `/v3/projects/3d8c7ee688b74cbca79abe62dd2321fe` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:36.372254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8c7ee688b74cbca79abe62dd2321fe)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:36.374293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:36.434194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8c7ee688b74cbca79abe62dd2321fe', 'request_id': 'req-ecbd8700-0696-42ee-bff0-63992c6e102e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.444573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8c7ee688b74cbca79abe62dd2321fe', 'request_id': 'req-ecbd8700-0696-42ee-bff0-63992c6e102e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.452260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8c7ee688b74cbca79abe62dd2321fe', 'request_id': 'req-ecbd8700-0696-42ee-bff0-63992c6e102e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.465724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] The token cache is being invalidate because project 3d8c7ee688b74cbca79abe62dd2321fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:36.466074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.466785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.468594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1037/2091] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:36 2022] DELETE /identity/v3/projects/3d8c7ee688b74cbca79abe62dd2321fe => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:36.472675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2c6d-65f2-4327-9bca-cb6135fee785 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:36.482276 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2c6d-65f2-4327-9bca-cb6135fee785 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:36.538970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:36.539863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:36.540214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:36.540487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] PATH_INFO: `/v3/users/7d77dbc3fa0f4e8f9b9740ea342d6434` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:36.541782 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d77dbc3fa0f4e8f9b9740ea342d6434)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:36.543730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:36.594876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d77dbc3fa0f4e8f9b9740ea342d6434'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.595727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d77dbc3fa0f4e8f9b9740ea342d6434'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.605857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d77dbc3fa0f4e8f9b9740ea342d6434'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.608936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:36.615210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d77dbc3fa0f4e8f9b9740ea342d6434'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.616162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0adf7d71-5419-40be-bf4c-a8ad35985672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d77dbc3fa0f4e8f9b9740ea342d6434'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:36.635405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1055/2092] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:36 2022] DELETE /identity/v3/users/7d77dbc3fa0f4e8f9b9740ea342d6434 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:36.991795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:36.993798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:37.010814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd8700-0696-42ee-bff0-63992c6e102e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.068882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.069758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.070033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.070300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] PATH_INFO: `/v3/projects/00a70c597fa44fe28e1487584d320923` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.071617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a70c597fa44fe28e1487584d320923)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.073549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.118758 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a70c597fa44fe28e1487584d320923', 'request_id': 'req-3041da76-2564-47b8-8ff9-63f627757359'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:37.127197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a70c597fa44fe28e1487584d320923', 'request_id': 'req-3041da76-2564-47b8-8ff9-63f627757359'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:37.132854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a70c597fa44fe28e1487584d320923', 'request_id': 'req-3041da76-2564-47b8-8ff9-63f627757359'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:37.143950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] The token cache is being invalidate because project 00a70c597fa44fe28e1487584d320923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:37.144242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:37.144887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3041da76-2564-47b8-8ff9-63f627757359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:37.146460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1038/2093] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:36 2022] DELETE /identity/v3/projects/00a70c597fa44fe28e1487584d320923 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:37.151734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0ab3-8454-483b-93bf-9fd6c80c7612 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.152197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0ab3-8454-483b-93bf-9fd6c80c7612 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.152306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034f0ab3-8454-483b-93bf-9fd6c80c7612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.170771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-034f0ab3-8454-483b-93bf-9fd6c80c7612 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:37.172027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-034f0ab3-8454-483b-93bf-9fd6c80c7612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:37.234408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1056/2094] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:37.242674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7fd79-2f24-426f-949d-9cc799c943fc None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.242985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7fd79-2f24-426f-949d-9cc799c943fc None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.243291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7fd79-2f24-426f-949d-9cc799c943fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.263083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e4a7fd79-2f24-426f-949d-9cc799c943fc None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:37.264342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e4a7fd79-2f24-426f-949d-9cc799c943fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:37.272782 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1039/2095] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:37.277319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f0ab3-8454-483b-93bf-9fd6c80c7612 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.287091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034f0ab3-8454-483b-93bf-9fd6c80c7612 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.291946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.292627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.292881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.293254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.294104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:43:37.294402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.296042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.308600 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1057/2096] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:43:37.313591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7fd79-2f24-426f-949d-9cc799c943fc None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.323773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7fd79-2f24-426f-949d-9cc799c943fc None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.329375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42684641-122e-48a6-9f11-7fb78caf876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.330402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42684641-122e-48a6-9f11-7fb78caf876a admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.330682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42684641-122e-48a6-9f11-7fb78caf876a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.331015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42684641-122e-48a6-9f11-7fb78caf876a admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.331737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42684641-122e-48a6-9f11-7fb78caf876a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.334527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42684641-122e-48a6-9f11-7fb78caf876a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.345595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:37.368142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1040/2097] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:43:37 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:43:37.372723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.383173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77b779-508e-4031-ab6e-c2a87d449254 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.440441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea8d4-659b-4a3b-982c-b390657ccb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.441411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea8d4-659b-4a3b-982c-b390657ccb8a admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.441685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea8d4-659b-4a3b-982c-b390657ccb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.441954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ea8d4-659b-4a3b-982c-b390657ccb8a admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.442636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ea8d4-659b-4a3b-982c-b390657ccb8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.444580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ea8d4-659b-4a3b-982c-b390657ccb8a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.463968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1058/2098] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:43:37 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:43:37.468202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42684641-122e-48a6-9f11-7fb78caf876a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.479248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42684641-122e-48a6-9f11-7fb78caf876a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.484889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8e2fb-daf8-4ce9-a9b9-1b96f2fb30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.485571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e2fb-daf8-4ce9-a9b9-1b96f2fb30ae admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.485853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e2fb-daf8-4ce9-a9b9-1b96f2fb30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.486123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8e2fb-daf8-4ce9-a9b9-1b96f2fb30ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.486861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8e2fb-daf8-4ce9-a9b9-1b96f2fb30ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.488487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8e2fb-daf8-4ce9-a9b9-1b96f2fb30ae admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.499577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1041/2099] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:43:37.503929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea8d4-659b-4a3b-982c-b390657ccb8a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.514950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ea8d4-659b-4a3b-982c-b390657ccb8a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.520438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3d381f-84af-4987-aea6-6e5b9005cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.521142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d381f-84af-4987-aea6-6e5b9005cfdd admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.521397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d381f-84af-4987-aea6-6e5b9005cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.521675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3d381f-84af-4987-aea6-6e5b9005cfdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.522414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d381f-84af-4987-aea6-6e5b9005cfdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.524085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3d381f-84af-4987-aea6-6e5b9005cfdd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.534742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1059/2100] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:37.538960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8e2fb-daf8-4ce9-a9b9-1b96f2fb30ae admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.549416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8e2fb-daf8-4ce9-a9b9-1b96f2fb30ae admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.554385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ba8e-b206-454e-b673-efe3b7b67b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.555230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ba8e-b206-454e-b673-efe3b7b67b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.555542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ba8e-b206-454e-b673-efe3b7b67b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.555851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f28ba8e-b206-454e-b673-efe3b7b67b75 admin admin] PATH_INFO: `/v3/projects/916e3542139e49a19e84809339b77e73/users/9f23f4b012904fa980969a6853dd54de/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.570728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28ba8e-b206-454e-b673-efe3b7b67b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916e3542139e49a19e84809339b77e73, user_id=9f23f4b012904fa980969a6853dd54de, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.573453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f28ba8e-b206-454e-b673-efe3b7b67b75 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.588009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1042/2101] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:37 2022] PUT /identity/v3/projects/916e3542139e49a19e84809339b77e73/users/9f23f4b012904fa980969a6853dd54de/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:37.599077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a4a1-fb99-46fa-9fed-ddb8796081b6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.599397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a4a1-fb99-46fa-9fed-ddb8796081b6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.599732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8212a4a1-fb99-46fa-9fed-ddb8796081b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.628309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8212a4a1-fb99-46fa-9fed-ddb8796081b6 None None] MFA Rules not processed for user `9f23f4b012904fa980969a6853dd54de`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:37.629680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8212a4a1-fb99-46fa-9fed-ddb8796081b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:37.659748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:37.699781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1060/2102] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:37.704295 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ba8e-b206-454e-b673-efe3b7b67b75 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.767629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f28ba8e-b206-454e-b673-efe3b7b67b75 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.772762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3db65-b091-431d-9414-5a2f02e410d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.773517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3db65-b091-431d-9414-5a2f02e410d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.773866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3db65-b091-431d-9414-5a2f02e410d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.774171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3db65-b091-431d-9414-5a2f02e410d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.775198 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3db65-b091-431d-9414-5a2f02e410d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.776970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3db65-b091-431d-9414-5a2f02e410d8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.804848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1043/2103] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:43:37 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:37.808170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212a4a1-fb99-46fa-9fed-ddb8796081b6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.819098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8212a4a1-fb99-46fa-9fed-ddb8796081b6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.875813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a917f0-adb5-4580-8bcc-8484e14e5ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.876599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a917f0-adb5-4580-8bcc-8484e14e5ada admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.876883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a917f0-adb5-4580-8bcc-8484e14e5ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.877158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a917f0-adb5-4580-8bcc-8484e14e5ada admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.877894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a917f0-adb5-4580-8bcc-8484e14e5ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.879852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a917f0-adb5-4580-8bcc-8484e14e5ada admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.902148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1061/2104] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:43:37 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:37.906439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3db65-b091-431d-9414-5a2f02e410d8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.917486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3db65-b091-431d-9414-5a2f02e410d8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.922612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74e625-d7ce-4e43-a15f-5e27adc6f263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.923309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74e625-d7ce-4e43-a15f-5e27adc6f263 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.923592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74e625-d7ce-4e43-a15f-5e27adc6f263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.923893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74e625-d7ce-4e43-a15f-5e27adc6f263 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.924640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74e625-d7ce-4e43-a15f-5e27adc6f263 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.926316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74e625-d7ce-4e43-a15f-5e27adc6f263 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.941829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1044/2105] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:37.943387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a917f0-adb5-4580-8bcc-8484e14e5ada admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:37.954091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a917f0-adb5-4580-8bcc-8484e14e5ada admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:37.958790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fded5-ca99-44d3-ae55-8128111e2730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:37.959745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fded5-ca99-44d3-ae55-8128111e2730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:37.960028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fded5-ca99-44d3-ae55-8128111e2730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:37.960306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fded5-ca99-44d3-ae55-8128111e2730 admin admin] PATH_INFO: `/v3/projects/e5d29c25216b4529b0108bc2f43c1bf4/users/bdd1fb59a1534f1d95d9a04c6366b7df/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:37.978431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fded5-ca99-44d3-ae55-8128111e2730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d29c25216b4529b0108bc2f43c1bf4, user_id=bdd1fb59a1534f1d95d9a04c6366b7df, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:37.981277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fded5-ca99-44d3-ae55-8128111e2730 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:37.996870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1062/2106] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:37 2022] PUT /identity/v3/projects/e5d29c25216b4529b0108bc2f43c1bf4/users/bdd1fb59a1534f1d95d9a04c6366b7df/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:38.001153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74e625-d7ce-4e43-a15f-5e27adc6f263 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:38.012301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74e625-d7ce-4e43-a15f-5e27adc6f263 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:38.074766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5078621c-0c1f-4f36-977e-ceaa0dc0522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:38.075456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078621c-0c1f-4f36-977e-ceaa0dc0522b admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:38.075773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078621c-0c1f-4f36-977e-ceaa0dc0522b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:38.076048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5078621c-0c1f-4f36-977e-ceaa0dc0522b admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:38.076791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078621c-0c1f-4f36-977e-ceaa0dc0522b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:38.078392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5078621c-0c1f-4f36-977e-ceaa0dc0522b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:38.088950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1045/2107] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:38.093692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fded5-ca99-44d3-ae55-8128111e2730 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:38.104676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fded5-ca99-44d3-ae55-8128111e2730 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:38.110391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:38.111309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:38.111591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:38.111905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] PATH_INFO: `/v3/projects/e5d29c25216b4529b0108bc2f43c1bf4/users/bdd1fb59a1534f1d95d9a04c6366b7df/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:38.114144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d29c25216b4529b0108bc2f43c1bf4, user_id=bdd1fb59a1534f1d95d9a04c6366b7df, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:38.116870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:38.128475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1063/2108] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:38 2022] PUT /identity/v3/projects/e5d29c25216b4529b0108bc2f43c1bf4/users/bdd1fb59a1534f1d95d9a04c6366b7df/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:43:38.138742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799c95-7095-4e26-a07e-860f733d8b84 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:38.139028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799c95-7095-4e26-a07e-860f733d8b84 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:38.139292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f799c95-7095-4e26-a07e-860f733d8b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:38.168762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5f799c95-7095-4e26-a07e-860f733d8b84 None None] MFA Rules not processed for user `bdd1fb59a1534f1d95d9a04c6366b7df`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:38.170016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5f799c95-7095-4e26-a07e-860f733d8b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:38.183344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:38.242286 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1046/2109] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:38.252983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:38.254754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:38.318905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf81058-9273-42e8-933d-ad448b57c366 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:38.323234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:38.323906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:38.324186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:38.324451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:38.358578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:38.383407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:38.385037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:38.395072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1064/2110] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:40.887248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c45cb9-fd4f-42e1-ab55-9a13375949ee None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:40.887944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c45cb9-fd4f-42e1-ab55-9a13375949ee None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:40.887944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c45cb9-fd4f-42e1-ab55-9a13375949ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:40.906908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-a5c45cb9-fd4f-42e1-ab55-9a13375949ee None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:40.908177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a5c45cb9-fd4f-42e1-ab55-9a13375949ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:40.957071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:40.958517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:40.970354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43abc497-a15e-4bb0-bd5e-70e9168913d1 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:40.974346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1fbb9-1cca-4efc-9517-8e5dd984f07c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:40.975098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1fbb9-1cca-4efc-9517-8e5dd984f07c service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:40.975384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1fbb9-1cca-4efc-9517-8e5dd984f07c service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:40.975498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1047/2111] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:40.975743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1fbb9-1cca-4efc-9517-8e5dd984f07c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:40.985051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1fbb9-1cca-4efc-9517-8e5dd984f07c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:40.986519 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1fbb9-1cca-4efc-9517-8e5dd984f07c service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:40.996473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1065/2112] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:43:40.996669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c45cb9-fd4f-42e1-ab55-9a13375949ee None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:40.998064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a5c45cb9-fd4f-42e1-ab55-9a13375949ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:41.076932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c45cb9-fd4f-42e1-ab55-9a13375949ee None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:41.082854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:41.083545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:41.083886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:41.084167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:41.093508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:41.095121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:41.105076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1048/2113] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:43:43.361057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001701f-6c10-4790-9fc5-8ac17fa892dd None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:43.361532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001701f-6c10-4790-9fc5-8ac17fa892dd None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:43.361619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001701f-6c10-4790-9fc5-8ac17fa892dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:43.380913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0001701f-6c10-4790-9fc5-8ac17fa892dd None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:43.382133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0001701f-6c10-4790-9fc5-8ac17fa892dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:43.443003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1066/2114] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:43:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:43.456005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:43.457424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:43.498558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:43.537410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e833b-f6df-404d-9546-380cc92a3aa4 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:43.543201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeaa38-beef-4a6c-b9d2-e5f983c0f914 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:43.543970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeaa38-beef-4a6c-b9d2-e5f983c0f914 service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:43.544474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeaa38-beef-4a6c-b9d2-e5f983c0f914 service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:43.544668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eeaa38-beef-4a6c-b9d2-e5f983c0f914 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:43.553909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eeaa38-beef-4a6c-b9d2-e5f983c0f914 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:43.555739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eeaa38-beef-4a6c-b9d2-e5f983c0f914 service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:43.565146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1049/2115] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:43:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:43:45.345534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db552d1-3041-4508-b468-24bbeb4ab41a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:45.346528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db552d1-3041-4508-b468-24bbeb4ab41a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:45.347337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db552d1-3041-4508-b468-24bbeb4ab41a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:45.377535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8db552d1-3041-4508-b468-24bbeb4ab41a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:45.379493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8db552d1-3041-4508-b468-24bbeb4ab41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:45.391827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1067/2116] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:45.420663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeaa38-beef-4a6c-b9d2-e5f983c0f914 service swift] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:45.436857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eeaa38-beef-4a6c-b9d2-e5f983c0f914 service swift] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:45.450316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6835f1-ce73-4849-82dd-a3a030f262a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:45.451827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6835f1-ce73-4849-82dd-a3a030f262a6 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:45.452469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6835f1-ce73-4849-82dd-a3a030f262a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:45.452983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6835f1-ce73-4849-82dd-a3a030f262a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:45.468725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6835f1-ce73-4849-82dd-a3a030f262a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:45.470293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6835f1-ce73-4849-82dd-a3a030f262a6 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:45.491974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1050/2117] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:48.418224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6468f-3ee7-4bf9-bc2a-c9be0c5d1939 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:48.418224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6468f-3ee7-4bf9-bc2a-c9be0c5d1939 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:48.419021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6468f-3ee7-4bf9-bc2a-c9be0c5d1939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:48.461714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d3d6468f-3ee7-4bf9-bc2a-c9be0c5d1939 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:48.463420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d3d6468f-3ee7-4bf9-bc2a-c9be0c5d1939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:48.476964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1068/2118] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:48.509182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6835f1-ce73-4849-82dd-a3a030f262a6 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:48.525296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6835f1-ce73-4849-82dd-a3a030f262a6 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:48.531414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa83e8-bc1e-450d-b377-d2bb89d98e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:48.532361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa83e8-bc1e-450d-b377-d2bb89d98e10 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:48.532831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa83e8-bc1e-450d-b377-d2bb89d98e10 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:48.533302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa83e8-bc1e-450d-b377-d2bb89d98e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:48.543803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa83e8-bc1e-450d-b377-d2bb89d98e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:48.546313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa83e8-bc1e-450d-b377-d2bb89d98e10 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:48.557564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1051/2119] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:54.005345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6468f-3ee7-4bf9-bc2a-c9be0c5d1939 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:54.016791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6468f-3ee7-4bf9-bc2a-c9be0c5d1939 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:54.023942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:54.025089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:54.025592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:54.026063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] PATH_INFO: `/v3/users/9f23f4b012904fa980969a6853dd54de` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:54.027783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f23f4b012904fa980969a6853dd54de)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:54.030596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:54.087993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f23f4b012904fa980969a6853dd54de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.089282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f23f4b012904fa980969a6853dd54de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.099438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f23f4b012904fa980969a6853dd54de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.109002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f23f4b012904fa980969a6853dd54de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.109787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f23f4b012904fa980969a6853dd54de'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.131183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1069/2120] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:54 2022] DELETE /identity/v3/users/9f23f4b012904fa980969a6853dd54de => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:54.136019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33905d-88c7-4b77-8232-8389fda16c49 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:54.136967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33905d-88c7-4b77-8232-8389fda16c49 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:54.137340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33905d-88c7-4b77-8232-8389fda16c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:54.156849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-fe33905d-88c7-4b77-8232-8389fda16c49 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:54.158486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fe33905d-88c7-4b77-8232-8389fda16c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:54.226109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1052/2121] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:54.236030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:54.237535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:54.271937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:54.309433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce4be7-4ebc-4dc2-9fdc-214f3784cc31 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:54.314431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd179a-2d6f-4bce-8341-dff9ec7ff979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:54.315359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd179a-2d6f-4bce-8341-dff9ec7ff979 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:54.315890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd179a-2d6f-4bce-8341-dff9ec7ff979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:54.316692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cd179a-2d6f-4bce-8341-dff9ec7ff979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:54.329094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd179a-2d6f-4bce-8341-dff9ec7ff979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:54.330567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cd179a-2d6f-4bce-8341-dff9ec7ff979 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:54.341564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1070/2122] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:43:54.680956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33905d-88c7-4b77-8232-8389fda16c49 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:54.682320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fe33905d-88c7-4b77-8232-8389fda16c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:54.711222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33905d-88c7-4b77-8232-8389fda16c49 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:54.720242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:54.722277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:54.722794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:54.723284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] PATH_INFO: `/v3/projects/916e3542139e49a19e84809339b77e73` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:54.724938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=916e3542139e49a19e84809339b77e73)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:54.727352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:54.791752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916e3542139e49a19e84809339b77e73', 'request_id': 'req-9388c8ab-f1d0-4d0f-a258-5845c358bf04'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.804050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916e3542139e49a19e84809339b77e73', 'request_id': 'req-9388c8ab-f1d0-4d0f-a258-5845c358bf04'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.830031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916e3542139e49a19e84809339b77e73', 'request_id': 'req-9388c8ab-f1d0-4d0f-a258-5845c358bf04'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.842734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] The token cache is being invalidate because project 916e3542139e49a19e84809339b77e73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:54.843027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.844865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:54.848816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1053/2123] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:54 2022] DELETE /identity/v3/projects/916e3542139e49a19e84809339b77e73 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:54.853353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd179a-2d6f-4bce-8341-dff9ec7ff979 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:54.865266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cd179a-2d6f-4bce-8341-dff9ec7ff979 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:54.960755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:54.962184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:54.963763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:54.964284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] PATH_INFO: `/v3/users/bdd1fb59a1534f1d95d9a04c6366b7df` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:54.965886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd1fb59a1534f1d95d9a04c6366b7df)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:54.968652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:55.038764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd1fb59a1534f1d95d9a04c6366b7df'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.040090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd1fb59a1534f1d95d9a04c6366b7df'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.050396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd1fb59a1534f1d95d9a04c6366b7df'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.059339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd1fb59a1534f1d95d9a04c6366b7df'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.060129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-58b2261f-8361-498b-a696-c43da7f417cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd1fb59a1534f1d95d9a04c6366b7df'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.097187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1071/2124] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:43:54 2022] DELETE /identity/v3/users/bdd1fb59a1534f1d95d9a04c6366b7df => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:55.406806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:55.409054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:55.444191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388c8ab-f1d0-4d0f-a258-5845c358bf04 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:55.470663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:55.519410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:55.521074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:55.521485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:55.521897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] PATH_INFO: `/v3/projects/e5d29c25216b4529b0108bc2f43c1bf4` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:55.525905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d29c25216b4529b0108bc2f43c1bf4)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:55.529145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:55.607362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d29c25216b4529b0108bc2f43c1bf4', 'request_id': 'req-1b1c8307-4718-42e0-9c41-ef066f9700ac'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.619966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d29c25216b4529b0108bc2f43c1bf4', 'request_id': 'req-1b1c8307-4718-42e0-9c41-ef066f9700ac'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.628134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d29c25216b4529b0108bc2f43c1bf4', 'request_id': 'req-1b1c8307-4718-42e0-9c41-ef066f9700ac'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.669840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] The token cache is being invalidate because project e5d29c25216b4529b0108bc2f43c1bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:43:55.670238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.671965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1b1c8307-4718-42e0-9c41-ef066f9700ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:43:55.677824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1054/2125] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:43:55 2022] DELETE /identity/v3/projects/e5d29c25216b4529b0108bc2f43c1bf4 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:55.682882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546fe6-95d3-456b-b485-526ae2d8fc1c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:55.683730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546fe6-95d3-456b-b485-526ae2d8fc1c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:55.684024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17546fe6-95d3-456b-b485-526ae2d8fc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:55.718433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-17546fe6-95d3-456b-b485-526ae2d8fc1c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:55.723199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-17546fe6-95d3-456b-b485-526ae2d8fc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:55.787104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:55.792233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db898-d5bf-4b87-9543-322090c5ec2c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:55.792571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db898-d5bf-4b87-9543-322090c5ec2c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:55.792948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db898-d5bf-4b87-9543-322090c5ec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:55.813312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1072/2126] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:55.821391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1a89-0e6d-444b-a64f-0f9a2b4c27fe None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:55.821825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1a89-0e6d-444b-a64f-0f9a2b4c27fe None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:55.822108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e1a89-0e6d-444b-a64f-0f9a2b4c27fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:55.824020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-436db898-d5bf-4b87-9543-322090c5ec2c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:55.826105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-436db898-d5bf-4b87-9543-322090c5ec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:55.838465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1055/2127] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:55.845134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7f8e1a89-0e6d-444b-a64f-0f9a2b4c27fe None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:55.846359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7f8e1a89-0e6d-444b-a64f-0f9a2b4c27fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:55.854663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1073/2128] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:43:55.860282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436db898-d5bf-4b87-9543-322090c5ec2c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:55.872573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436db898-d5bf-4b87-9543-322090c5ec2c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:55.889153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:55.889153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:55.889153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:55.889153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:55.889667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:43:55.889667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:55.889667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:55.905847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1056/2129] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:43:55.907710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1a89-0e6d-444b-a64f-0f9a2b4c27fe None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:55.919053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e1a89-0e6d-444b-a64f-0f9a2b4c27fe None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:55.924176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712b9e-dd08-4aad-8807-70854ec75b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:55.925409 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712b9e-dd08-4aad-8807-70854ec75b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:55.925698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712b9e-dd08-4aad-8807-70854ec75b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:55.925980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75712b9e-dd08-4aad-8807-70854ec75b92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:55.934346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75712b9e-dd08-4aad-8807-70854ec75b92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:55.934567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:55.935588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:55.940801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75712b9e-dd08-4aad-8807-70854ec75b92 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:55.990034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1074/2130] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:43:55 2022] POST /identity/v3/projects => generated 401 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:55.994070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712b9e-dd08-4aad-8807-70854ec75b92 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.081812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75712b9e-dd08-4aad-8807-70854ec75b92 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.086685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394b1b6-165b-4995-a7d8-f74886eac222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.087761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394b1b6-165b-4995-a7d8-f74886eac222 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.088147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394b1b6-165b-4995-a7d8-f74886eac222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.089134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394b1b6-165b-4995-a7d8-f74886eac222 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.089916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394b1b6-165b-4995-a7d8-f74886eac222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.092194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394b1b6-165b-4995-a7d8-f74886eac222 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.093576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc43b70-a11f-492e-8d0d-d67b930fe649 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.151065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:56.152134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1075/2131] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:43:55 2022] POST /identity/v3/users => generated 301 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:56.156458 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394b1b6-165b-4995-a7d8-f74886eac222 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.167925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394b1b6-165b-4995-a7d8-f74886eac222 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.172808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ab79d-dad4-4a5f-bbba-4810c24d07ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.173563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ab79d-dad4-4a5f-bbba-4810c24d07ef admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.173834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ab79d-dad4-4a5f-bbba-4810c24d07ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.174098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37ab79d-dad4-4a5f-bbba-4810c24d07ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.175018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ab79d-dad4-4a5f-bbba-4810c24d07ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.176752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37ab79d-dad4-4a5f-bbba-4810c24d07ef admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.189730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1076/2132] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:56.196850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ab79d-dad4-4a5f-bbba-4810c24d07ef admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.200335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628b5b1-4314-4c69-86ed-57a656fbbb50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.201111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b5b1-4314-4c69-86ed-57a656fbbb50 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.201495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b5b1-4314-4c69-86ed-57a656fbbb50 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.201886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628b5b1-4314-4c69-86ed-57a656fbbb50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.211788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628b5b1-4314-4c69-86ed-57a656fbbb50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.213728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628b5b1-4314-4c69-86ed-57a656fbbb50 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.222465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37ab79d-dad4-4a5f-bbba-4810c24d07ef admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.230252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1057/2133] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:43:56.234414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658a21a-559f-4b4b-9017-99a19759ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.235411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a21a-559f-4b4b-9017-99a19759ffd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.235829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a21a-559f-4b4b-9017-99a19759ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.236423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a21a-559f-4b4b-9017-99a19759ffd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.237244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658a21a-559f-4b4b-9017-99a19759ffd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.240227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658a21a-559f-4b4b-9017-99a19759ffd2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.253468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1077/2134] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:56.257172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628b5b1-4314-4c69-86ed-57a656fbbb50 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.267565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628b5b1-4314-4c69-86ed-57a656fbbb50 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.272484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934e201-0654-4dae-930a-3d578dd53ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.273453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e201-0654-4dae-930a-3d578dd53ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.273855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e201-0654-4dae-930a-3d578dd53ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.274195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934e201-0654-4dae-930a-3d578dd53ffa admin admin] PATH_INFO: `/v3/projects/111d6262b7ad4d27a62b9af8974fe433/users/58ba096fd24241b4af22551fdff47177/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.292152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934e201-0654-4dae-930a-3d578dd53ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=111d6262b7ad4d27a62b9af8974fe433, user_id=58ba096fd24241b4af22551fdff47177, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.295517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934e201-0654-4dae-930a-3d578dd53ffa admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.312224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1058/2135] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:56 2022] PUT /identity/v3/projects/111d6262b7ad4d27a62b9af8974fe433/users/58ba096fd24241b4af22551fdff47177/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:56.324258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc12f9-b95a-4578-aca4-8051bfdf728f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.324793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc12f9-b95a-4578-aca4-8051bfdf728f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.325265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc12f9-b95a-4578-aca4-8051bfdf728f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.354889 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b9bc12f9-b95a-4578-aca4-8051bfdf728f None None] MFA Rules not processed for user `58ba096fd24241b4af22551fdff47177`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:56.356728 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b9bc12f9-b95a-4578-aca4-8051bfdf728f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:56.477565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1078/2136] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:56.481876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934e201-0654-4dae-930a-3d578dd53ffa admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.588348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934e201-0654-4dae-930a-3d578dd53ffa admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.594161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb67e-84c8-48df-a907-44d23d499cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.594846 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb67e-84c8-48df-a907-44d23d499cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.595187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb67e-84c8-48df-a907-44d23d499cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.595477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cb67e-84c8-48df-a907-44d23d499cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.596383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb67e-84c8-48df-a907-44d23d499cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.598303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cb67e-84c8-48df-a907-44d23d499cd8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.631734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1059/2137] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:43:56 2022] POST /identity/v3/projects => generated 401 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:43:56.634968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc12f9-b95a-4578-aca4-8051bfdf728f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.649055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc12f9-b95a-4578-aca4-8051bfdf728f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.669543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:56.733870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bd95f-2d5c-422d-9123-4efa57b54c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.734672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bd95f-2d5c-422d-9123-4efa57b54c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.735038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bd95f-2d5c-422d-9123-4efa57b54c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.735382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609bd95f-2d5c-422d-9123-4efa57b54c3c admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.736206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bd95f-2d5c-422d-9123-4efa57b54c3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.738204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609bd95f-2d5c-422d-9123-4efa57b54c3c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.766607 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1079/2138] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:43:56 2022] POST /identity/v3/users => generated 307 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:43:56.770531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb67e-84c8-48df-a907-44d23d499cd8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.788813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cb67e-84c8-48df-a907-44d23d499cd8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.794894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3761a-7f37-4d4f-ab43-b6839f71ad73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.797053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3761a-7f37-4d4f-ab43-b6839f71ad73 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.797520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3761a-7f37-4d4f-ab43-b6839f71ad73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.797939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3761a-7f37-4d4f-ab43-b6839f71ad73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.798778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3761a-7f37-4d4f-ab43-b6839f71ad73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.800371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3761a-7f37-4d4f-ab43-b6839f71ad73 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.816126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1060/2139] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:56.820835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bd95f-2d5c-422d-9123-4efa57b54c3c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.831523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609bd95f-2d5c-422d-9123-4efa57b54c3c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.837378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dd8b4-7a44-4e04-a83d-4b4e79cb38b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.838305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dd8b4-7a44-4e04-a83d-4b4e79cb38b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.838574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dd8b4-7a44-4e04-a83d-4b4e79cb38b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.838838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8dd8b4-7a44-4e04-a83d-4b4e79cb38b3 admin admin] PATH_INFO: `/v3/projects/60bd380c2adc4ee0a4a5e92ffde4c6b8/users/6f2c6fef69944a46af0b0d6aa9ea67a6/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.855985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dd8b4-7a44-4e04-a83d-4b4e79cb38b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bd380c2adc4ee0a4a5e92ffde4c6b8, user_id=6f2c6fef69944a46af0b0d6aa9ea67a6, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.858710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8dd8b4-7a44-4e04-a83d-4b4e79cb38b3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.874904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1080/2140] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:56 2022] PUT /identity/v3/projects/60bd380c2adc4ee0a4a5e92ffde4c6b8/users/6f2c6fef69944a46af0b0d6aa9ea67a6/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:56.878732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3761a-7f37-4d4f-ab43-b6839f71ad73 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:56.908473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3761a-7f37-4d4f-ab43-b6839f71ad73 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:56.979200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb3bfc-bb95-4f3f-b084-968c96ff44ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:56.979946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb3bfc-bb95-4f3f-b084-968c96ff44ce admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:56.980232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb3bfc-bb95-4f3f-b084-968c96ff44ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:56.980565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb3bfc-bb95-4f3f-b084-968c96ff44ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:56.981272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb3bfc-bb95-4f3f-b084-968c96ff44ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:56.982990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb3bfc-bb95-4f3f-b084-968c96ff44ce admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:56.994180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1061/2141] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:43:56.998698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dd8b4-7a44-4e04-a83d-4b4e79cb38b3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:57.011671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8dd8b4-7a44-4e04-a83d-4b4e79cb38b3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:57.017158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:57.018323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:57.018796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:57.019258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] PATH_INFO: `/v3/projects/60bd380c2adc4ee0a4a5e92ffde4c6b8/users/6f2c6fef69944a46af0b0d6aa9ea67a6/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:57.022337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=60bd380c2adc4ee0a4a5e92ffde4c6b8, user_id=6f2c6fef69944a46af0b0d6aa9ea67a6, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:57.025490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:57.037629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1081/2142] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:43:56 2022] PUT /identity/v3/projects/60bd380c2adc4ee0a4a5e92ffde4c6b8/users/6f2c6fef69944a46af0b0d6aa9ea67a6/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:43:57.048116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63272e-ac04-4616-85ad-2fdccfac7b92 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:57.048604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63272e-ac04-4616-85ad-2fdccfac7b92 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:57.049061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63272e-ac04-4616-85ad-2fdccfac7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:57.055103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:43:57.084544 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-2b63272e-ac04-4616-85ad-2fdccfac7b92 None None] MFA Rules not processed for user `6f2c6fef69944a46af0b0d6aa9ea67a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:43:57.085902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2b63272e-ac04-4616-85ad-2fdccfac7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:57.160249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1062/2143] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:43:57 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:43:57.176802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:57.179304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:43:57.245395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eae008-9df5-448c-b1f2-db7b170877fd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:57.252699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f7194-3861-4d11-973e-146cd11ab70b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:57.253691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f7194-3861-4d11-973e-146cd11ab70b service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:57.254460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f7194-3861-4d11-973e-146cd11ab70b service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:57.254916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f7194-3861-4d11-973e-146cd11ab70b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:57.271189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f7194-3861-4d11-973e-146cd11ab70b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:57.273621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f7194-3861-4d11-973e-146cd11ab70b service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:57.287882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1082/2144] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:57 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:43:57.369601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63272e-ac04-4616-85ad-2fdccfac7b92 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:43:57.380518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63272e-ac04-4616-85ad-2fdccfac7b92 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:43:57.386306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:43:57.387097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:43:57.387474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:43:57.387871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:43:57.453467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:43:57.454908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:43:57.475823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1063/2145] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:43:57 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:00.896654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b271-2658-45df-9671-fe2545e19397 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:00.897214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b271-2658-45df-9671-fe2545e19397 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:00.897214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e724b271-2658-45df-9671-fe2545e19397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:00.916063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e724b271-2658-45df-9671-fe2545e19397 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:00.917169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e724b271-2658-45df-9671-fe2545e19397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:00.985374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1083/2146] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 12 13:44:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:00.998184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:00.999798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:01.072438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb8250-e00e-4a28-a149-9cdc53ddaa3f service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:01.078398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ff7732-e9d9-4314-aa0f-10b8ef7f1b7a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:01.079056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7732-e9d9-4314-aa0f-10b8ef7f1b7a service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:01.079373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7732-e9d9-4314-aa0f-10b8ef7f1b7a service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:01.079647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ff7732-e9d9-4314-aa0f-10b8ef7f1b7a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:01.087992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7732-e9d9-4314-aa0f-10b8ef7f1b7a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:01.089604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ff7732-e9d9-4314-aa0f-10b8ef7f1b7a service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:01.097767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1064/2147] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:44:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:44:01.781613 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724b271-2658-45df-9671-fe2545e19397 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:01.801381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:01.849675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e724b271-2658-45df-9671-fe2545e19397 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:01.854737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:01.855646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:01.855946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:01.856217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] PATH_INFO: `/v3/users/58ba096fd24241b4af22551fdff47177` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:01.857419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ba096fd24241b4af22551fdff47177)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:01.859343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:01.914957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ba096fd24241b4af22551fdff47177'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:01.915695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ba096fd24241b4af22551fdff47177'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:01.924042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ba096fd24241b4af22551fdff47177'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:01.932043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ba096fd24241b4af22551fdff47177'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:01.932717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ba096fd24241b4af22551fdff47177'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:01.951388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1084/2148] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:44:01 2022] DELETE /identity/v3/users/58ba096fd24241b4af22551fdff47177 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:01.955941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c03ed3-3645-4fdd-b1fb-b9e716c170f9 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:01.956336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c03ed3-3645-4fdd-b1fb-b9e716c170f9 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:01.956592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c03ed3-3645-4fdd-b1fb-b9e716c170f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:01.974502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-03c03ed3-3645-4fdd-b1fb-b9e716c170f9 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:01.975901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-03c03ed3-3645-4fdd-b1fb-b9e716c170f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:01.988164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:02.040467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1065/2149] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:02.050535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:02.052213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:02.114236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5ab6b-39d9-410d-a0bd-9de703f39bcd admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:02.119294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a648d4-e2fc-4eba-80e9-bd86e61e7450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:02.120063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a648d4-e2fc-4eba-80e9-bd86e61e7450 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:02.120382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a648d4-e2fc-4eba-80e9-bd86e61e7450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:02.120678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a648d4-e2fc-4eba-80e9-bd86e61e7450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:02.132185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a648d4-e2fc-4eba-80e9-bd86e61e7450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:02.133635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a648d4-e2fc-4eba-80e9-bd86e61e7450 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:02.143491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1085/2150] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:02.420950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c03ed3-3645-4fdd-b1fb-b9e716c170f9 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:02.422417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-03c03ed3-3645-4fdd-b1fb-b9e716c170f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:02.435522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c03ed3-3645-4fdd-b1fb-b9e716c170f9 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:02.440585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:02.441913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:02.442238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:02.442521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] PATH_INFO: `/v3/projects/111d6262b7ad4d27a62b9af8974fe433` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:02.443920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=111d6262b7ad4d27a62b9af8974fe433)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:02.445916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:02.503962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111d6262b7ad4d27a62b9af8974fe433', 'request_id': 'req-e4e32857-9694-4043-8d5d-73c3b546cb8b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.512439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111d6262b7ad4d27a62b9af8974fe433', 'request_id': 'req-e4e32857-9694-4043-8d5d-73c3b546cb8b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.518767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111d6262b7ad4d27a62b9af8974fe433', 'request_id': 'req-e4e32857-9694-4043-8d5d-73c3b546cb8b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.537819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] The token cache is being invalidate because project 111d6262b7ad4d27a62b9af8974fe433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:44:02.538201 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.538946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.546251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1066/2151] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:44:02 2022] DELETE /identity/v3/projects/111d6262b7ad4d27a62b9af8974fe433 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:02.551624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a648d4-e2fc-4eba-80e9-bd86e61e7450 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:02.558934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a648d4-e2fc-4eba-80e9-bd86e61e7450 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:02.606336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:02.627843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:02.628733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:02.629017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:02.629297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] PATH_INFO: `/v3/users/6f2c6fef69944a46af0b0d6aa9ea67a6` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:02.630515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2c6fef69944a46af0b0d6aa9ea67a6)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:02.632479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:02.682572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2c6fef69944a46af0b0d6aa9ea67a6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.683160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2c6fef69944a46af0b0d6aa9ea67a6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.691097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2c6fef69944a46af0b0d6aa9ea67a6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.698596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2c6fef69944a46af0b0d6aa9ea67a6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.699242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc71d9ba-44af-4426-b33e-4c0564d04e6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2c6fef69944a46af0b0d6aa9ea67a6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:02.717169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1086/2152] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:44:02 2022] DELETE /identity/v3/users/6f2c6fef69944a46af0b0d6aa9ea67a6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:03.075842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.077621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.094556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e32857-9694-4043-8d5d-73c3b546cb8b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.162468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed581f-d345-46eb-90b5-99e860ccb83e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.163514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed581f-d345-46eb-90b5-99e860ccb83e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.163880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed581f-d345-46eb-90b5-99e860ccb83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.180809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.182130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.182593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.183122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] PATH_INFO: `/v3/projects/60bd380c2adc4ee0a4a5e92ffde4c6b8` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.184798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60bd380c2adc4ee0a4a5e92ffde4c6b8)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.187008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.195264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-04ed581f-d345-46eb-90b5-99e860ccb83e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:03.197437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-04ed581f-d345-46eb-90b5-99e860ccb83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.213935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1087/2153] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:03.236981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed581f-d345-46eb-90b5-99e860ccb83e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.238753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-04ed581f-d345-46eb-90b5-99e860ccb83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.239982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:03.246796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60bd380c2adc4ee0a4a5e92ffde4c6b8', 'request_id': 'req-69f88bba-a02a-4ea7-a710-24eae94dd92b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.258637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60bd380c2adc4ee0a4a5e92ffde4c6b8', 'request_id': 'req-69f88bba-a02a-4ea7-a710-24eae94dd92b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.265740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60bd380c2adc4ee0a4a5e92ffde4c6b8', 'request_id': 'req-69f88bba-a02a-4ea7-a710-24eae94dd92b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.278429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] The token cache is being invalidate because project 60bd380c2adc4ee0a4a5e92ffde4c6b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:44:03.278945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.280042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-69f88bba-a02a-4ea7-a710-24eae94dd92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.282265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1067/2154] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:44:03 2022] DELETE /identity/v3/projects/60bd380c2adc4ee0a4a5e92ffde4c6b8 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:03.287128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4680418-2764-455c-9f80-4ef97a08ae8b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.288010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4680418-2764-455c-9f80-4ef97a08ae8b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.288424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4680418-2764-455c-9f80-4ef97a08ae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.311415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e4680418-2764-455c-9f80-4ef97a08ae8b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:03.313949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e4680418-2764-455c-9f80-4ef97a08ae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.343280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed581f-d345-46eb-90b5-99e860ccb83e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.404597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:03.413312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1068/2155] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:44:03.414862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc28bf-7096-4f7f-a8ca-1fea1df1149b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.415661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc28bf-7096-4f7f-a8ca-1fea1df1149b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.416054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fc28bf-7096-4f7f-a8ca-1fea1df1149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.441096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179027a-f65d-49f3-b0f0-5038037ecd8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.442068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e2fc28bf-7096-4f7f-a8ca-1fea1df1149b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:03.442704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179027a-f65d-49f3-b0f0-5038037ecd8c service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.443056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179027a-f65d-49f3-b0f0-5038037ecd8c service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.443448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e2fc28bf-7096-4f7f-a8ca-1fea1df1149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.444495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179027a-f65d-49f3-b0f0-5038037ecd8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.447304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5179027a-f65d-49f3-b0f0-5038037ecd8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.455802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1069/2156] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:03.464522 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d045a8-fbbd-4e67-aa79-0a14e4377ddc None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.464819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d045a8-fbbd-4e67-aa79-0a14e4377ddc None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.465105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d045a8-fbbd-4e67-aa79-0a14e4377ddc None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.466672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1070/2157] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:44:03 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:44:03.467262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d045a8-fbbd-4e67-aa79-0a14e4377ddc None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.469431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179027a-f65d-49f3-b0f0-5038037ecd8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.471126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179027a-f65d-49f3-b0f0-5038037ecd8c service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.481181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d045a8-fbbd-4e67-aa79-0a14e4377ddc None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.483579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1088/2158] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:03.485303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f47bc-28da-4633-a22b-07a2c9436612 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.485594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f47bc-28da-4633-a22b-07a2c9436612 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.485875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f47bc-28da-4633-a22b-07a2c9436612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.486351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bc8f8-3d2c-41a4-8b2a-dfed3071905f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.487020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bc8f8-3d2c-41a4-8b2a-dfed3071905f admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.487334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bc8f8-3d2c-41a4-8b2a-dfed3071905f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.487705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bc8f8-3d2c-41a4-8b2a-dfed3071905f admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.488643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bc8f8-3d2c-41a4-8b2a-dfed3071905f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:44:03.488802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bc8f8-3d2c-41a4-8b2a-dfed3071905f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.490603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bc8f8-3d2c-41a4-8b2a-dfed3071905f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.507091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1071/2159] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:44:03.507091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd7b5-0b60-4c74-9393-0fa718c6a158 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.507091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd7b5-0b60-4c74-9393-0fa718c6a158 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.507091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cd7b5-0b60-4c74-9393-0fa718c6a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.518525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-036f47bc-28da-4633-a22b-07a2c9436612 None None] MFA Rules not processed for user `2eb98f1b1bf440ba8c3d10894f5518be`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:03.519786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-036f47bc-28da-4633-a22b-07a2c9436612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.526329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6f5cd7b5-0b60-4c74-9393-0fa718c6a158 None None] MFA Rules not processed for user `2d373d537efc44de9382e6c4cdaf6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:03.527775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6f5cd7b5-0b60-4c74-9393-0fa718c6a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.581455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1089/2160] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:03.587280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f47bc-28da-4633-a22b-07a2c9436612 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.588651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-036f47bc-28da-4633-a22b-07a2c9436612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.603355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f47bc-28da-4633-a22b-07a2c9436612 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.608244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.609275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1072/2161] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:44:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:03.609402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.609524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.609892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] PATH_INFO: `/v3/users/9ace3acc926b4b5580ff15a060c040ee` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.610024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cd7b5-0b60-4c74-9393-0fa718c6a158 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.611424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ace3acc926b4b5580ff15a060c040ee)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.613503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.631777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5cd7b5-0b60-4c74-9393-0fa718c6a158 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.637595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.638270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.638690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.638969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.639685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.642667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.679296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1073/2162] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:44:03 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:44:03.680231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.681954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.682965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ace3acc926b4b5580ff15a060c040ee'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.683713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ace3acc926b4b5580ff15a060c040ee'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.693440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ace3acc926b4b5580ff15a060c040ee'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.703255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ace3acc926b4b5580ff15a060c040ee'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.703991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ace3acc926b4b5580ff15a060c040ee'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:03.717375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:03.725036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1090/2163] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:44:03 2022] DELETE /identity/v3/users/9ace3acc926b4b5580ff15a060c040ee => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:03.726067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.729310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.769633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82942f-a8ae-4b07-8398-4ed0516b7058 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.811283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:03.829452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795ff3a-48b6-42c9-9d3d-5e8c6f2c3c6e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.836801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac62bd-9483-4240-9bdd-d4830e9ff1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.838095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac62bd-9483-4240-9bdd-d4830e9ff1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.838493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac62bd-9483-4240-9bdd-d4830e9ff1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.838716 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac62bd-9483-4240-9bdd-d4830e9ff1c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.839783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac62bd-9483-4240-9bdd-d4830e9ff1c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.842140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ac62bd-9483-4240-9bdd-d4830e9ff1c2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.855917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.856683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.857139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.857498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.860286 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.867763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1091/2164] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:44:03 2022] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:44:03.871845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac62bd-9483-4240-9bdd-d4830e9ff1c2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.879821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.882304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.884001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac62bd-9483-4240-9bdd-d4830e9ff1c2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.889097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.890052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.890352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.890871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.891786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.893407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.903229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1074/2165] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:03.909853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1092/2166] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:44:03.913997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.928116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc06ea-c93a-4cd7-bc48-bccf2fa52133 service placement] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.934316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b4c6-e40c-4a7e-a4c2-2d1b5806f96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.935058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b4c6-e40c-4a7e-a4c2-2d1b5806f96d admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.935499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b4c6-e40c-4a7e-a4c2-2d1b5806f96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.935701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650b4c6-e40c-4a7e-a4c2-2d1b5806f96d admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.936423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650b4c6-e40c-4a7e-a4c2-2d1b5806f96d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.938050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c650b4c6-e40c-4a7e-a4c2-2d1b5806f96d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.943332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.945991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:03.951156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1075/2167] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:44:03.955260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b4c6-e40c-4a7e-a4c2-2d1b5806f96d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:03.968122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c650b4c6-e40c-4a7e-a4c2-2d1b5806f96d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.970063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48faca9a-d621-4847-9578-aaca5c895206 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:03.973314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a4a8c8-6a95-48c7-a452-fc36c3d35598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.974330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a8c8-6a95-48c7-a452-fc36c3d35598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.974827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a8c8-6a95-48c7-a452-fc36c3d35598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.974940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a4a8c8-6a95-48c7-a452-fc36c3d35598 admin admin] PATH_INFO: `/v3/projects/0acd7aedef5142d8963be834ab87e57b/users/a8e6b99a26ee41e4b74fcc6e25f3712f/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.986314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:03.987326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:03.987714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:03.988042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] PATH_INFO: `/v3/projects/c7e521ea370a48cea74a6a23cabd6875` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:03.989301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e521ea370a48cea74a6a23cabd6875)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.991279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:03.995950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4a8c8-6a95-48c7-a452-fc36c3d35598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0acd7aedef5142d8963be834ab87e57b, user_id=a8e6b99a26ee41e4b74fcc6e25f3712f, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:03.998685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a4a8c8-6a95-48c7-a452-fc36c3d35598 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.014646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1076/2168] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:44:03 2022] PUT /identity/v3/projects/0acd7aedef5142d8963be834ab87e57b/users/a8e6b99a26ee41e4b74fcc6e25f3712f/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:44:04.024968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2a0ed-5b85-49d3-8bf3-54664e3e43ec None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.025753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2a0ed-5b85-49d3-8bf3-54664e3e43ec None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.026040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2a0ed-5b85-49d3-8bf3-54664e3e43ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.051867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e521ea370a48cea74a6a23cabd6875', 'request_id': 'req-f45b24af-f55d-4dba-8945-d5911b10c448'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:04.055277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-30f2a0ed-5b85-49d3-8bf3-54664e3e43ec None None] MFA Rules not processed for user `a8e6b99a26ee41e4b74fcc6e25f3712f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:04.056815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-30f2a0ed-5b85-49d3-8bf3-54664e3e43ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:04.058843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e521ea370a48cea74a6a23cabd6875', 'request_id': 'req-f45b24af-f55d-4dba-8945-d5911b10c448'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:04.067164 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e521ea370a48cea74a6a23cabd6875', 'request_id': 'req-f45b24af-f55d-4dba-8945-d5911b10c448'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:04.080628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] The token cache is being invalidate because project c7e521ea370a48cea74a6a23cabd6875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:44:04.080628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:04.081352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f45b24af-f55d-4dba-8945-d5911b10c448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:04.083523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1093/2169] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:44:03 2022] DELETE /identity/v3/projects/c7e521ea370a48cea74a6a23cabd6875 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:04.093253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f3f1-0278-4800-9cca-1ccdb523bd66 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.093678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f3f1-0278-4800-9cca-1ccdb523bd66 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.094508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d7f3f1-0278-4800-9cca-1ccdb523bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.116954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-08d7f3f1-0278-4800-9cca-1ccdb523bd66 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:04.118192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-08d7f3f1-0278-4800-9cca-1ccdb523bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:04.127026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1077/2170] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:44:04.131893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2a0ed-5b85-49d3-8bf3-54664e3e43ec None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.133927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-30f2a0ed-5b85-49d3-8bf3-54664e3e43ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:04.160151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:04.196321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1094/2171] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:04.204756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0c1a-ec12-40df-9a39-2f2061941804 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.205223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0c1a-ec12-40df-9a39-2f2061941804 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.205400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a0c1a-ec12-40df-9a39-2f2061941804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.220393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2a0ed-5b85-49d3-8bf3-54664e3e43ec None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.224190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-711a0c1a-ec12-40df-9a39-2f2061941804 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:04.225392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-711a0c1a-ec12-40df-9a39-2f2061941804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:04.225512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce66f4-2a05-46c0-875e-69dc438bfd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.226105 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce66f4-2a05-46c0-875e-69dc438bfd23 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.226385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce66f4-2a05-46c0-875e-69dc438bfd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.226651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce66f4-2a05-46c0-875e-69dc438bfd23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.227338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce66f4-2a05-46c0-875e-69dc438bfd23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.229282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce66f4-2a05-46c0-875e-69dc438bfd23 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.233945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1095/2172] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:44:04.237925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0c1a-ec12-40df-9a39-2f2061941804 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.247812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a0c1a-ec12-40df-9a39-2f2061941804 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.253841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.254510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.254801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.255338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.256171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:44:04.256485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.261832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.264385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1078/2173] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:44:04.268376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce66f4-2a05-46c0-875e-69dc438bfd23 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.274943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1096/2174] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:44:04.280583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.299964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d662b0-85b5-4dcf-821f-874e55d9897c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.347201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:04.358587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce66f4-2a05-46c0-875e-69dc438bfd23 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.364729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61642bc9-fa2c-4013-9c96-6d04ab670109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.365529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61642bc9-fa2c-4013-9c96-6d04ab670109 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.365972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61642bc9-fa2c-4013-9c96-6d04ab670109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.366250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61642bc9-fa2c-4013-9c96-6d04ab670109 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.367085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61642bc9-fa2c-4013-9c96-6d04ab670109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.369151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61642bc9-fa2c-4013-9c96-6d04ab670109 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.377546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73681afb-7d2c-4e30-a647-3b6220546e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.378223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681afb-7d2c-4e30-a647-3b6220546e24 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.378504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681afb-7d2c-4e30-a647-3b6220546e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.378769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73681afb-7d2c-4e30-a647-3b6220546e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.379460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73681afb-7d2c-4e30-a647-3b6220546e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.381382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73681afb-7d2c-4e30-a647-3b6220546e24 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.395810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1079/2175] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:44:04.399033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61642bc9-fa2c-4013-9c96-6d04ab670109 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.410217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1097/2176] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:44:04.413146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73681afb-7d2c-4e30-a647-3b6220546e24 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.414262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61642bc9-fa2c-4013-9c96-6d04ab670109 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.482605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd246-0cf2-44fb-b7d9-271ce148eb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.483224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd246-0cf2-44fb-b7d9-271ce148eb66 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.483499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd246-0cf2-44fb-b7d9-271ce148eb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.483864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8dd246-0cf2-44fb-b7d9-271ce148eb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.484619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dd246-0cf2-44fb-b7d9-271ce148eb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.486262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8dd246-0cf2-44fb-b7d9-271ce148eb66 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.491379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73681afb-7d2c-4e30-a647-3b6220546e24 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.496934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749be902-889f-4869-814b-4582dd649b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.497375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1080/2177] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:44:04.498062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be902-889f-4869-814b-4582dd649b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.498324 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be902-889f-4869-814b-4582dd649b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.498604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749be902-889f-4869-814b-4582dd649b2e admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.499313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749be902-889f-4869-814b-4582dd649b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.501391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749be902-889f-4869-814b-4582dd649b2e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.501656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd246-0cf2-44fb-b7d9-271ce148eb66 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.512689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8dd246-0cf2-44fb-b7d9-271ce148eb66 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.517570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ad5f5-9040-4c8a-af57-d8fe870b8549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.518617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad5f5-9040-4c8a-af57-d8fe870b8549 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.519013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad5f5-9040-4c8a-af57-d8fe870b8549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.519273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ad5f5-9040-4c8a-af57-d8fe870b8549 admin admin] PATH_INFO: `/v3/projects/62021b7de0244ff28877f10f02d09c8c/users/74fd0eed275849fd8cdbdb9de5235517/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.526526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1098/2178] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:44:04.528141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749be902-889f-4869-814b-4582dd649b2e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.536932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ad5f5-9040-4c8a-af57-d8fe870b8549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62021b7de0244ff28877f10f02d09c8c, user_id=74fd0eed275849fd8cdbdb9de5235517, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.538300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749be902-889f-4869-814b-4582dd649b2e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.540448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ad5f5-9040-4c8a-af57-d8fe870b8549 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.543216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff65e4c-13ac-416f-a3ba-fcfd41a15617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.544018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff65e4c-13ac-416f-a3ba-fcfd41a15617 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.544318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff65e4c-13ac-416f-a3ba-fcfd41a15617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.544602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff65e4c-13ac-416f-a3ba-fcfd41a15617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.545306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff65e4c-13ac-416f-a3ba-fcfd41a15617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.546881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff65e4c-13ac-416f-a3ba-fcfd41a15617 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.550598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:04.559049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1081/2179] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:44:04 2022] PUT /identity/v3/projects/62021b7de0244ff28877f10f02d09c8c/users/74fd0eed275849fd8cdbdb9de5235517/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:04.562500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1099/2180] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:44:04.565298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ad5f5-9040-4c8a-af57-d8fe870b8549 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.566327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff65e4c-13ac-416f-a3ba-fcfd41a15617 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.579060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff65e4c-13ac-416f-a3ba-fcfd41a15617 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.636840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ad5f5-9040-4c8a-af57-d8fe870b8549 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.641710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4251eed-1401-4a6c-af3d-12db9aa37b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.642469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251eed-1401-4a6c-af3d-12db9aa37b0f admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.642787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251eed-1401-4a6c-af3d-12db9aa37b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.642885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec5c9a-9753-491a-aaa1-b9aae12b1900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.643089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4251eed-1401-4a6c-af3d-12db9aa37b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.643695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec5c9a-9753-491a-aaa1-b9aae12b1900 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.643857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4251eed-1401-4a6c-af3d-12db9aa37b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.644089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec5c9a-9753-491a-aaa1-b9aae12b1900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.644427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec5c9a-9753-491a-aaa1-b9aae12b1900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.645750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec5c9a-9753-491a-aaa1-b9aae12b1900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.645858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4251eed-1401-4a6c-af3d-12db9aa37b0f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.646899 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec5c9a-9753-491a-aaa1-b9aae12b1900 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.659890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1100/2181] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:44:04.663791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec5c9a-9753-491a-aaa1-b9aae12b1900 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.675464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1082/2182] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:44:04.675665 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec5c9a-9753-491a-aaa1-b9aae12b1900 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.676647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4251eed-1401-4a6c-af3d-12db9aa37b0f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.680158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b13769-7448-4d2d-a101-ed843d981ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.681227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13769-7448-4d2d-a101-ed843d981ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.681504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13769-7448-4d2d-a101-ed843d981ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.682204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b13769-7448-4d2d-a101-ed843d981ac6 admin admin] PATH_INFO: `/v3/projects/30b7738f469e4e9890327e370c7b80c6/users/1547c0a72f9c40ea9e53d810f31cc6c6/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.687525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4251eed-1401-4a6c-af3d-12db9aa37b0f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.693151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6026049-e7c7-4d28-baa4-6066d1047409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.694120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026049-e7c7-4d28-baa4-6066d1047409 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.694501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026049-e7c7-4d28-baa4-6066d1047409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.694950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6026049-e7c7-4d28-baa4-6066d1047409 admin admin] PATH_INFO: `/v3/projects/62021b7de0244ff28877f10f02d09c8c/users/74fd0eed275849fd8cdbdb9de5235517/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.697829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6026049-e7c7-4d28-baa4-6066d1047409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62021b7de0244ff28877f10f02d09c8c, user_id=74fd0eed275849fd8cdbdb9de5235517, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.699730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13769-7448-4d2d-a101-ed843d981ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b7738f469e4e9890327e370c7b80c6, user_id=1547c0a72f9c40ea9e53d810f31cc6c6, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.702167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6026049-e7c7-4d28-baa4-6066d1047409 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.702559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b13769-7448-4d2d-a101-ed843d981ac6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.716746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1083/2183] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:44:04 2022] PUT /identity/v3/projects/62021b7de0244ff28877f10f02d09c8c/users/74fd0eed275849fd8cdbdb9de5235517/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:04.717016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1101/2184] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:44:04 2022] PUT /identity/v3/projects/30b7738f469e4e9890327e370c7b80c6/users/1547c0a72f9c40ea9e53d810f31cc6c6/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:44:04.727037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca5d0-0fb7-47b2-86b4-3001c0d16361 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.727329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca5d0-0fb7-47b2-86b4-3001c0d16361 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.727495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a80312-db8c-49e2-8ff0-644e48a36a97 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.727742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3ca5d0-0fb7-47b2-86b4-3001c0d16361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.728121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a80312-db8c-49e2-8ff0-644e48a36a97 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.728406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a80312-db8c-49e2-8ff0-644e48a36a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.746622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:04.755161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-dd3ca5d0-0fb7-47b2-86b4-3001c0d16361 None None] MFA Rules not processed for user `1547c0a72f9c40ea9e53d810f31cc6c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:04.757095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dd3ca5d0-0fb7-47b2-86b4-3001c0d16361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:04.759587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-98a80312-db8c-49e2-8ff0-644e48a36a97 None None] MFA Rules not processed for user `74fd0eed275849fd8cdbdb9de5235517`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:04.760812 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-98a80312-db8c-49e2-8ff0-644e48a36a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:04.833952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1102/2185] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:04.843644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1084/2186] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:04.846805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca5d0-0fb7-47b2-86b4-3001c0d16361 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.848246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dd3ca5d0-0fb7-47b2-86b4-3001c0d16361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:04.852468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a80312-db8c-49e2-8ff0-644e48a36a97 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:04.853923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-98a80312-db8c-49e2-8ff0-644e48a36a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:04.908791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3ca5d0-0fb7-47b2-86b4-3001c0d16361 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.911561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a80312-db8c-49e2-8ff0-644e48a36a97 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:04.912443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56245fe9-5434-432e-9378-1bca925d14ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.913105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56245fe9-5434-432e-9378-1bca925d14ac service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.913392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56245fe9-5434-432e-9378-1bca925d14ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.913665 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56245fe9-5434-432e-9378-1bca925d14ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.915272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e320e-9b11-469e-97d3-682c7aa1ba7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:04.916003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e320e-9b11-469e-97d3-682c7aa1ba7b service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:04.916228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e320e-9b11-469e-97d3-682c7aa1ba7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:04.916504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e320e-9b11-469e-97d3-682c7aa1ba7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:04.922455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56245fe9-5434-432e-9378-1bca925d14ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.923959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56245fe9-5434-432e-9378-1bca925d14ac service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.927222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e320e-9b11-469e-97d3-682c7aa1ba7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:04.928677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3e320e-9b11-469e-97d3-682c7aa1ba7b service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:04.933223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1103/2187] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:04.940861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1085/2188] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:44:05.038395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56245fe9-5434-432e-9378-1bca925d14ac service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:05.046784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56245fe9-5434-432e-9378-1bca925d14ac service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:05.050371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be4f30-3cc2-43e3-86b1-59a55e6dcabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:05.051010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be4f30-3cc2-43e3-86b1-59a55e6dcabd service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:05.051287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be4f30-3cc2-43e3-86b1-59a55e6dcabd service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:05.051558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be4f30-3cc2-43e3-86b1-59a55e6dcabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:05.112698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be4f30-3cc2-43e3-86b1-59a55e6dcabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:05.114135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be4f30-3cc2-43e3-86b1-59a55e6dcabd service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:05.123879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1104/2189] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:07.532779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e320e-9b11-469e-97d3-682c7aa1ba7b service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:07.545217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:07.618629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3e320e-9b11-469e-97d3-682c7aa1ba7b service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:07.624453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:07.625366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:07.625668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:07.625898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] PATH_INFO: `/v3/users/1547c0a72f9c40ea9e53d810f31cc6c6` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:07.627117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1547c0a72f9c40ea9e53d810f31cc6c6)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:07.629339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:07.699684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1547c0a72f9c40ea9e53d810f31cc6c6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.712100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1547c0a72f9c40ea9e53d810f31cc6c6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.713097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1547c0a72f9c40ea9e53d810f31cc6c6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.725512 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1547c0a72f9c40ea9e53d810f31cc6c6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.745600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8bbbc049-e67d-419d-b6c5-83dfae6aea4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1547c0a72f9c40ea9e53d810f31cc6c6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.754765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be4f30-3cc2-43e3-86b1-59a55e6dcabd service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:07.757353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1086/2190] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:44:07 2022] DELETE /identity/v3/users/1547c0a72f9c40ea9e53d810f31cc6c6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:07.765113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179d90-353a-4231-8624-c5dbcf6a44e2 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:07.765406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179d90-353a-4231-8624-c5dbcf6a44e2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:07.765684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08179d90-353a-4231-8624-c5dbcf6a44e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:07.772001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be4f30-3cc2-43e3-86b1-59a55e6dcabd service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:07.787945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-08179d90-353a-4231-8624-c5dbcf6a44e2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:07.789262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-08179d90-353a-4231-8624-c5dbcf6a44e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:07.861781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:07.868697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1087/2191] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:07.879731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179d90-353a-4231-8624-c5dbcf6a44e2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:07.881397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-08179d90-353a-4231-8624-c5dbcf6a44e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:07.886356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:07.887584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:07.888040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:07.888493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] PATH_INFO: `/v3/users/a8e6b99a26ee41e4b74fcc6e25f3712f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:07.889749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e6b99a26ee41e4b74fcc6e25f3712f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:07.892584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:07.923736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:07.951063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e6b99a26ee41e4b74fcc6e25f3712f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.951836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e6b99a26ee41e4b74fcc6e25f3712f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.960872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e6b99a26ee41e4b74fcc6e25f3712f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.961413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08179d90-353a-4231-8624-c5dbcf6a44e2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:07.965925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350c0644-0fd4-4fff-ba30-8966318faf92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:07.966743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0644-0fd4-4fff-ba30-8966318faf92 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:07.967149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0644-0fd4-4fff-ba30-8966318faf92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:07.967496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350c0644-0fd4-4fff-ba30-8966318faf92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:07.970695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e6b99a26ee41e4b74fcc6e25f3712f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.972483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e6b99a26ee41e4b74fcc6e25f3712f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:07.979818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0644-0fd4-4fff-ba30-8966318faf92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:07.981437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350c0644-0fd4-4fff-ba30-8966318faf92 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:08.010567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1088/2192] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:08.018157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1105/2193] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:44:07 2022] DELETE /identity/v3/users/a8e6b99a26ee41e4b74fcc6e25f3712f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:08.021760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df552cd-4232-49ae-b2ad-300e0384964a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:08.022268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df552cd-4232-49ae-b2ad-300e0384964a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:08.022769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df552cd-4232-49ae-b2ad-300e0384964a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:08.044637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3df552cd-4232-49ae-b2ad-300e0384964a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:08.045981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3df552cd-4232-49ae-b2ad-300e0384964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:08.116090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1089/2194] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:44:08.127404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:08.129193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:08.200021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffb51cc-b5f0-4b81-ade7-d2c3e6d2841b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:08.204103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:08.204857 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:08.205079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:08.205848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:08.220147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:08.222206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:08.233835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1106/2195] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:08.850159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df552cd-4232-49ae-b2ad-300e0384964a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:08.853572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3df552cd-4232-49ae-b2ad-300e0384964a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:08.867718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df552cd-4232-49ae-b2ad-300e0384964a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:08.873245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:08.876884 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:08.876884 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:08.876884 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] PATH_INFO: `/v3/projects/30b7738f469e4e9890327e370c7b80c6` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:08.878986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b7738f469e4e9890327e370c7b80c6)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:08.881962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:08.961041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b7738f469e4e9890327e370c7b80c6', 'request_id': 'req-5e94befd-1c9b-49f4-8151-6961d85da176'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:08.970318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b7738f469e4e9890327e370c7b80c6', 'request_id': 'req-5e94befd-1c9b-49f4-8151-6961d85da176'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:08.977851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b7738f469e4e9890327e370c7b80c6', 'request_id': 'req-5e94befd-1c9b-49f4-8151-6961d85da176'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:08.992156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] The token cache is being invalidate because project 30b7738f469e4e9890327e370c7b80c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:44:08.992468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:08.993203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:08.994830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1090/2196] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:44:08 2022] DELETE /identity/v3/projects/30b7738f469e4e9890327e370c7b80c6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:44:09.145129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:09.147465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:09.163885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5687e1-6fab-4775-b4ce-030fbe784288 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:09.224834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:09.225706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:09.226008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:09.226667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] PATH_INFO: `/v3/projects/0acd7aedef5142d8963be834ab87e57b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:09.228355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0acd7aedef5142d8963be834ab87e57b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:09.230263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:09.236703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:09.279098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0acd7aedef5142d8963be834ab87e57b', 'request_id': 'req-0df03e40-2202-439d-804f-6868dff19372'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.285711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0acd7aedef5142d8963be834ab87e57b', 'request_id': 'req-0df03e40-2202-439d-804f-6868dff19372'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.296839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0acd7aedef5142d8963be834ab87e57b', 'request_id': 'req-0df03e40-2202-439d-804f-6868dff19372'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.313274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] The token cache is being invalidate because project 0acd7aedef5142d8963be834ab87e57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:44:09.313568 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.314260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.315921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1107/2197] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:44:09 2022] DELETE /identity/v3/projects/0acd7aedef5142d8963be834ab87e57b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:09.320498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:09.322081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:09.335015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94befd-1c9b-49f4-8151-6961d85da176 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:09.385119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:09.392571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:09.393634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:09.394150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:09.394488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] PATH_INFO: `/v3/users/74fd0eed275849fd8cdbdb9de5235517` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:09.396365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=74fd0eed275849fd8cdbdb9de5235517)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:09.398496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:09.446657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74fd0eed275849fd8cdbdb9de5235517'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.456412 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74fd0eed275849fd8cdbdb9de5235517'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.457155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74fd0eed275849fd8cdbdb9de5235517'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.464438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74fd0eed275849fd8cdbdb9de5235517'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.476028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-470047fa-c5a1-4fda-bfc8-a60a6efd1c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74fd0eed275849fd8cdbdb9de5235517'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.482138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1091/2198] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:44:09 2022] DELETE /identity/v3/users/74fd0eed275849fd8cdbdb9de5235517 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:09.773465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:09.775096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:09.790916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df03e40-2202-439d-804f-6868dff19372 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:09.850095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:09.850962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:09.851241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:09.851522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] PATH_INFO: `/v3/projects/62021b7de0244ff28877f10f02d09c8c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:09.852824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62021b7de0244ff28877f10f02d09c8c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:09.854740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:09.903723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62021b7de0244ff28877f10f02d09c8c', 'request_id': 'req-38c1c28d-cf77-4316-92ca-45e679ded6a5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.910179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62021b7de0244ff28877f10f02d09c8c', 'request_id': 'req-38c1c28d-cf77-4316-92ca-45e679ded6a5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.920052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62021b7de0244ff28877f10f02d09c8c', 'request_id': 'req-38c1c28d-cf77-4316-92ca-45e679ded6a5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.930784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] The token cache is being invalidate because project 62021b7de0244ff28877f10f02d09c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:44:09.931074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.931760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-38c1c28d-cf77-4316-92ca-45e679ded6a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:09.933330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1108/2199] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:44:09 2022] DELETE /identity/v3/projects/62021b7de0244ff28877f10f02d09c8c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:09.938294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1285-3ffd-4a0a-a279-e8e3a48fad7a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:09.938752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1285-3ffd-4a0a-a279-e8e3a48fad7a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:09.938843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d1285-3ffd-4a0a-a279-e8e3a48fad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:09.958551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ee8d1285-3ffd-4a0a-a279-e8e3a48fad7a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:09.959776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ee8d1285-3ffd-4a0a-a279-e8e3a48fad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:10.023119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1092/2200] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:10.090337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ab61d-cee2-427b-aff4-e1028091a5f7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.090602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ab61d-cee2-427b-aff4-e1028091a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.090907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ab61d-cee2-427b-aff4-e1028091a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.109644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-696ab61d-cee2-427b-aff4-e1028091a5f7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:10.110874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-696ab61d-cee2-427b-aff4-e1028091a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:10.119659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1109/2201] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:10.124107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d1285-3ffd-4a0a-a279-e8e3a48fad7a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:10.133914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d1285-3ffd-4a0a-a279-e8e3a48fad7a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:10.138720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:10.139401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.139711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.139987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.140722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:44:10.141041 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:10.142776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:10.158307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1093/2202] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:44:10.159461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ab61d-cee2-427b-aff4-e1028091a5f7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:10.169068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ab61d-cee2-427b-aff4-e1028091a5f7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:10.175111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d99bb3-bb27-4dbb-a755-6f25cd577fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:10.175404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d99bb3-bb27-4dbb-a755-6f25cd577fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.175716 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d99bb3-bb27-4dbb-a755-6f25cd577fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.175991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d99bb3-bb27-4dbb-a755-6f25cd577fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.176696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d99bb3-bb27-4dbb-a755-6f25cd577fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:10.178609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d99bb3-bb27-4dbb-a755-6f25cd577fe7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:10.195041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:10.219353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1110/2203] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:44:10 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:44:10.223705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:10.233585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6363f0-a38b-4f55-9605-147e283eac51 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:10.290912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb5125-263f-45a3-a495-56b863e3a366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:10.291671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5125-263f-45a3-a495-56b863e3a366 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.291919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5125-263f-45a3-a495-56b863e3a366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.292199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfb5125-263f-45a3-a495-56b863e3a366 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.293059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb5125-263f-45a3-a495-56b863e3a366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:10.294987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfb5125-263f-45a3-a495-56b863e3a366 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:10.302897 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:10.317312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1094/2204] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:44:10 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:44:10.326938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d99bb3-bb27-4dbb-a755-6f25cd577fe7 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:10.338415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d99bb3-bb27-4dbb-a755-6f25cd577fe7 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:10.343462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d174c-a4d8-4d86-bd25-d85dc36273cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:10.344187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d174c-a4d8-4d86-bd25-d85dc36273cf admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.344467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d174c-a4d8-4d86-bd25-d85dc36273cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.344740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d174c-a4d8-4d86-bd25-d85dc36273cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.345479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d174c-a4d8-4d86-bd25-d85dc36273cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:10.347130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d174c-a4d8-4d86-bd25-d85dc36273cf admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:10.358213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1111/2205] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:44:10.362236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb5125-263f-45a3-a495-56b863e3a366 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:10.372389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfb5125-263f-45a3-a495-56b863e3a366 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:10.378393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824adee-2888-49e6-9e2f-51f3c101cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:10.379062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824adee-2888-49e6-9e2f-51f3c101cb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.379347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824adee-2888-49e6-9e2f-51f3c101cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.379628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824adee-2888-49e6-9e2f-51f3c101cb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.380386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824adee-2888-49e6-9e2f-51f3c101cb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:10.381974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824adee-2888-49e6-9e2f-51f3c101cb4d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:10.392707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1095/2206] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:44:10.397077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d174c-a4d8-4d86-bd25-d85dc36273cf admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:10.407504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d174c-a4d8-4d86-bd25-d85dc36273cf admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:10.412723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:10.413539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.413839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.414146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] PATH_INFO: `/v3/projects/63457359764c4cff9f781f792b16d730/users/9459ee312b394fcf82a4eb3442f4b3a8/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.430671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63457359764c4cff9f781f792b16d730, user_id=9459ee312b394fcf82a4eb3442f4b3a8, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:10.433387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:10.449122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1112/2207] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:44:10 2022] PUT /identity/v3/projects/63457359764c4cff9f781f792b16d730/users/9459ee312b394fcf82a4eb3442f4b3a8/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:10.456988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78226-f61c-4a78-9347-eb382f093695 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.457349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78226-f61c-4a78-9347-eb382f093695 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.457646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78226-f61c-4a78-9347-eb382f093695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.477429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3be78226-f61c-4a78-9347-eb382f093695 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:10.478690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3be78226-f61c-4a78-9347-eb382f093695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:10.539336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1096/2208] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:10.549866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:10.552467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:10.611781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46462651-b7c6-497f-a099-19c7d14bf428 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:10.615836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5430-76a7-47de-a55f-3eadf58daafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:10.616520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5430-76a7-47de-a55f-3eadf58daafb service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:10.616784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5430-76a7-47de-a55f-3eadf58daafb service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:10.617063 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d5430-76a7-47de-a55f-3eadf58daafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:10.626533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5430-76a7-47de-a55f-3eadf58daafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:10.627995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d5430-76a7-47de-a55f-3eadf58daafb service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:10.639045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1113/2209] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:11.249148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf9c7-c2a5-4b24-91b9-c75af704dd3a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:11.249665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf9c7-c2a5-4b24-91b9-c75af704dd3a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:11.249765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcf9c7-c2a5-4b24-91b9-c75af704dd3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:11.283469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e7bcf9c7-c2a5-4b24-91b9-c75af704dd3a None None] MFA Rules not processed for user `9459ee312b394fcf82a4eb3442f4b3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:11.283469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e7bcf9c7-c2a5-4b24-91b9-c75af704dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:11.372405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1097/2210] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:11.376742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5430-76a7-47de-a55f-3eadf58daafb service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:11.390499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d5430-76a7-47de-a55f-3eadf58daafb service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:11.396261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfea19-2e93-4c69-8fea-30d582aaab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:11.397416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfea19-2e93-4c69-8fea-30d582aaab1e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:11.397416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfea19-2e93-4c69-8fea-30d582aaab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:11.397584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecfea19-2e93-4c69-8fea-30d582aaab1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:11.400591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfea19-2e93-4c69-8fea-30d582aaab1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:11.400591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecfea19-2e93-4c69-8fea-30d582aaab1e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:11.444571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1114/2211] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:44:11 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:44:11.449670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcf9c7-c2a5-4b24-91b9-c75af704dd3a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:11.463638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bcf9c7-c2a5-4b24-91b9-c75af704dd3a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:11.523331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34345a-3ef4-4175-ae8c-c70a2b0b6f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:11.524498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34345a-3ef4-4175-ae8c-c70a2b0b6f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:11.524784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34345a-3ef4-4175-ae8c-c70a2b0b6f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:11.525062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34345a-3ef4-4175-ae8c-c70a2b0b6f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:11.525778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34345a-3ef4-4175-ae8c-c70a2b0b6f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:11.527724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34345a-3ef4-4175-ae8c-c70a2b0b6f86 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:11.545162 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:11.553306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1098/2212] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:44:11 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:44:11.554490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfea19-2e93-4c69-8fea-30d582aaab1e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:11.564649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecfea19-2e93-4c69-8fea-30d582aaab1e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:11.569732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac591a8a-36b5-4c50-8e1b-0511849897bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:11.570398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591a8a-36b5-4c50-8e1b-0511849897bf admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:11.570679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591a8a-36b5-4c50-8e1b-0511849897bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:11.570954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac591a8a-36b5-4c50-8e1b-0511849897bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:11.571834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac591a8a-36b5-4c50-8e1b-0511849897bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:11.573428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac591a8a-36b5-4c50-8e1b-0511849897bf admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:11.583920 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1115/2213] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:44:11.588107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34345a-3ef4-4175-ae8c-c70a2b0b6f86 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:11.598134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34345a-3ef4-4175-ae8c-c70a2b0b6f86 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:11.602863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66eec0-1816-4350-b5d6-1d89303c5e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:11.603793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66eec0-1816-4350-b5d6-1d89303c5e79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:11.604091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66eec0-1816-4350-b5d6-1d89303c5e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:11.604394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e66eec0-1816-4350-b5d6-1d89303c5e79 admin admin] PATH_INFO: `/v3/projects/9ca629ec31be451692eb070655ade9ff/users/1e0ee4333ec24df0adb82ea8e2db86d4/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:11.619153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66eec0-1816-4350-b5d6-1d89303c5e79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca629ec31be451692eb070655ade9ff, user_id=1e0ee4333ec24df0adb82ea8e2db86d4, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:11.621837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e66eec0-1816-4350-b5d6-1d89303c5e79 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:11.637564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1099/2214] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:44:11 2022] PUT /identity/v3/projects/9ca629ec31be451692eb070655ade9ff/users/1e0ee4333ec24df0adb82ea8e2db86d4/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:11.641724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac591a8a-36b5-4c50-8e1b-0511849897bf admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:11.652202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac591a8a-36b5-4c50-8e1b-0511849897bf admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:11.710866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f891a27-d405-43c7-923b-a7f5a15a1085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:11.711446 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f891a27-d405-43c7-923b-a7f5a15a1085 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:11.711910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f891a27-d405-43c7-923b-a7f5a15a1085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:11.712448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f891a27-d405-43c7-923b-a7f5a15a1085 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:11.713534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f891a27-d405-43c7-923b-a7f5a15a1085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:11.715799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f891a27-d405-43c7-923b-a7f5a15a1085 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:11.728480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1116/2215] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:44:11.735018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66eec0-1816-4350-b5d6-1d89303c5e79 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:11.748920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e66eec0-1816-4350-b5d6-1d89303c5e79 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:11.754664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7567712-eaf6-4c2f-997a-1bd38fe559de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:11.755554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7567712-eaf6-4c2f-997a-1bd38fe559de admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:11.756009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7567712-eaf6-4c2f-997a-1bd38fe559de admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:11.756283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7567712-eaf6-4c2f-997a-1bd38fe559de admin admin] PATH_INFO: `/v3/projects/9ca629ec31be451692eb070655ade9ff/users/1e0ee4333ec24df0adb82ea8e2db86d4/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:11.758538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7567712-eaf6-4c2f-997a-1bd38fe559de admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca629ec31be451692eb070655ade9ff, user_id=1e0ee4333ec24df0adb82ea8e2db86d4, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:11.761191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7567712-eaf6-4c2f-997a-1bd38fe559de admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:11.772501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1100/2216] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:44:11 2022] PUT /identity/v3/projects/9ca629ec31be451692eb070655ade9ff/users/1e0ee4333ec24df0adb82ea8e2db86d4/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:12.406026 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703c15-6514-47af-bcbe-eca4dac28687 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:12.406547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703c15-6514-47af-bcbe-eca4dac28687 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:12.406738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703c15-6514-47af-bcbe-eca4dac28687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:12.437540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-31703c15-6514-47af-bcbe-eca4dac28687 None None] MFA Rules not processed for user `1e0ee4333ec24df0adb82ea8e2db86d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:12.438789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-31703c15-6514-47af-bcbe-eca4dac28687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:12.453924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:12.527182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1117/2217] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:44:12.537228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee40c-27d2-483d-9409-4dbb78da16ad None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:12.537793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee40c-27d2-483d-9409-4dbb78da16ad None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:12.537793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee40c-27d2-483d-9409-4dbb78da16ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:12.563396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1f1ee40c-27d2-483d-9409-4dbb78da16ad None None] MFA Rules not processed for user `9459ee312b394fcf82a4eb3442f4b3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:12.564641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1f1ee40c-27d2-483d-9409-4dbb78da16ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:12.637665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1101/2218] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:12.653012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703c15-6514-47af-bcbe-eca4dac28687 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:12.654445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-31703c15-6514-47af-bcbe-eca4dac28687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:12.731154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703c15-6514-47af-bcbe-eca4dac28687 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:12.737964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:12.738624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:12.738907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:12.739185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:12.749021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:12.750606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:12.761592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1118/2219] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:22.632302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=40,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:22.756083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=56 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:23.271473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ba38-e7e2-44c1-80f3-370f01ce515c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:23.272142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ba38-e7e2-44c1-80f3-370f01ce515c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:23.272633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2ba38-e7e2-44c1-80f3-370f01ce515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:23.319998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-23f2ba38-e7e2-44c1-80f3-370f01ce515c None None] MFA Rules not processed for user `09a69bba369d4037ae66e240eb8e556b`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:23.323655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-23f2ba38-e7e2-44c1-80f3-370f01ce515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:23.429956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1102/2220] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:31.477311 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:31.478854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:31.538572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609f6b3-edeb-4798-9c94-e46b048df2bb service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:31.542971 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162a6d5-dfea-4595-a433-4abb89c04971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:31.543648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a6d5-dfea-4595-a433-4abb89c04971 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:31.543938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a6d5-dfea-4595-a433-4abb89c04971 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:31.544214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162a6d5-dfea-4595-a433-4abb89c04971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:31.553606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162a6d5-dfea-4595-a433-4abb89c04971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:31.555037 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162a6d5-dfea-4595-a433-4abb89c04971 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:31.564878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1119/2221] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:31.705332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2ba38-e7e2-44c1-80f3-370f01ce515c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:31.707734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-23f2ba38-e7e2-44c1-80f3-370f01ce515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:31.789708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2ba38-e7e2-44c1-80f3-370f01ce515c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:31.797278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb899-1343-4fea-8ed5-6fbbb583f6ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:31.798086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb899-1343-4fea-8ed5-6fbbb583f6ac service placement] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:31.798463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb899-1343-4fea-8ed5-6fbbb583f6ac service placement] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:31.798909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb899-1343-4fea-8ed5-6fbbb583f6ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:31.800924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3b9fb899-1343-4fea-8ed5-6fbbb583f6ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:31.818674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fb899-1343-4fea-8ed5-6fbbb583f6ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:31.820472 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9fb899-1343-4fea-8ed5-6fbbb583f6ac service placement] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:31.846219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1103/2222] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:33.635158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d766b-1455-41f0-ab5e-d53f6a6bef4d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:33.635686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d766b-1455-41f0-ab5e-d53f6a6bef4d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:33.635821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d766b-1455-41f0-ab5e-d53f6a6bef4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:33.656160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-386d766b-1455-41f0-ab5e-d53f6a6bef4d None None] MFA Rules not processed for user `636181e787714128869124b40ab14c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:33.657481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-386d766b-1455-41f0-ab5e-d53f6a6bef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:33.716099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1120/2223] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:41.830032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=57 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:43.709168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=51 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:50.753883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c412-6c5c-447d-b268-ee62f97be87a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:50.754419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c412-6c5c-447d-b268-ee62f97be87a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:50.754419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7c412-6c5c-447d-b268-ee62f97be87a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:50.773406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-78b7c412-6c5c-447d-b268-ee62f97be87a None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:50.774749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-78b7c412-6c5c-447d-b268-ee62f97be87a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:50.834700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1104/2224] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:44:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:50.856543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d766b-1455-41f0-ab5e-d53f6a6bef4d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:50.858236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-386d766b-1455-41f0-ab5e-d53f6a6bef4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:50.932686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386d766b-1455-41f0-ab5e-d53f6a6bef4d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:50.940284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:50.941032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:50.941403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:50.941576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:50.952944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:50.952944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:50.961227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1121/2225] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:44:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:44:51.619711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd5c9-33d0-45e2-81e8-a49dbbc6c080 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:51.620110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd5c9-33d0-45e2-81e8-a49dbbc6c080 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:51.620313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd5c9-33d0-45e2-81e8-a49dbbc6c080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:51.653375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5c2dd5c9-33d0-45e2-81e8-a49dbbc6c080 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:51.655101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5c2dd5c9-33d0-45e2-81e8-a49dbbc6c080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:51.746269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1105/2226] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:51.768234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:51.769908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:51.789987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f544be-8604-4881-a517-2a11e798cafb service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:51.797789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aeb5a-fb72-4749-b915-c41fe0d370a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:51.798467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aeb5a-fb72-4749-b915-c41fe0d370a9 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:51.798747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aeb5a-fb72-4749-b915-c41fe0d370a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:51.799021 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114aeb5a-fb72-4749-b915-c41fe0d370a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:51.811473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114aeb5a-fb72-4749-b915-c41fe0d370a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:51.813137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114aeb5a-fb72-4749-b915-c41fe0d370a9 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:51.823660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1122/2227] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:57.059388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858310-1483-45e1-a655-fe53d73397ee None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:57.059951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858310-1483-45e1-a655-fe53d73397ee None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:57.060068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31858310-1483-45e1-a655-fe53d73397ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:57.096844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-31858310-1483-45e1-a655-fe53d73397ee None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:57.098388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-31858310-1483-45e1-a655-fe53d73397ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:57.111694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1106/2228] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:44:57.145481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aeb5a-fb72-4749-b915-c41fe0d370a9 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:57.161611 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114aeb5a-fb72-4749-b915-c41fe0d370a9 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:57.174597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afe307-3233-48b7-bbf5-8e51ee9ef3b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:57.175845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afe307-3233-48b7-bbf5-8e51ee9ef3b0 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:57.176481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afe307-3233-48b7-bbf5-8e51ee9ef3b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:57.176994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afe307-3233-48b7-bbf5-8e51ee9ef3b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:57.190029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afe307-3233-48b7-bbf5-8e51ee9ef3b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:57.193297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afe307-3233-48b7-bbf5-8e51ee9ef3b0 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:57.206705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1123/2229] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:44:58.416574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31858310-1483-45e1-a655-fe53d73397ee None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:58.428741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31858310-1483-45e1-a655-fe53d73397ee None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:58.437848 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:58.438995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:58.439275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:58.439549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] PATH_INFO: `/v3/users/9459ee312b394fcf82a4eb3442f4b3a8` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:58.440940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9459ee312b394fcf82a4eb3442f4b3a8)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:58.443729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:58.501379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9459ee312b394fcf82a4eb3442f4b3a8'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.511425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9459ee312b394fcf82a4eb3442f4b3a8'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.512151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9459ee312b394fcf82a4eb3442f4b3a8'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.521138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9459ee312b394fcf82a4eb3442f4b3a8'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.540646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9459ee312b394fcf82a4eb3442f4b3a8'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.552126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1107/2230] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:44:58 2022] DELETE /identity/v3/users/9459ee312b394fcf82a4eb3442f4b3a8 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:58.761577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afe307-3233-48b7-bbf5-8e51ee9ef3b0 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:58.773020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afe307-3233-48b7-bbf5-8e51ee9ef3b0 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:58.845750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:58.846640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:58.846925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:58.847204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] PATH_INFO: `/v3/projects/63457359764c4cff9f781f792b16d730` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:58.848461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63457359764c4cff9f781f792b16d730)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:58.850426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:58.902385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63457359764c4cff9f781f792b16d730', 'request_id': 'req-60eef650-6d77-4296-ae93-8ae69d67b293'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.909316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63457359764c4cff9f781f792b16d730', 'request_id': 'req-60eef650-6d77-4296-ae93-8ae69d67b293'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.918836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63457359764c4cff9f781f792b16d730', 'request_id': 'req-60eef650-6d77-4296-ae93-8ae69d67b293'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.924768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:58.935756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] The token cache is being invalidate because project 63457359764c4cff9f781f792b16d730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:44:58.936827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.938200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:58.940365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1124/2231] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:44:58 2022] DELETE /identity/v3/projects/63457359764c4cff9f781f792b16d730 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:44:58.945334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:58.947983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:58.965994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bbd1c-e6e9-4d66-bb88-8fbfa521c717 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:58.977441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:59.059247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:59.060571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:59.060963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:59.061312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] PATH_INFO: `/v3/users/1e0ee4333ec24df0adb82ea8e2db86d4` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:59.062644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e0ee4333ec24df0adb82ea8e2db86d4)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:59.065971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:59.142256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e0ee4333ec24df0adb82ea8e2db86d4'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.153280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e0ee4333ec24df0adb82ea8e2db86d4'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.154340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e0ee4333ec24df0adb82ea8e2db86d4'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.173002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e0ee4333ec24df0adb82ea8e2db86d4'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.197744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40db86bc-d1ec-44c7-8b63-62bd6e989171 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e0ee4333ec24df0adb82ea8e2db86d4'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.205996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1108/2232] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:44:58 2022] DELETE /identity/v3/users/1e0ee4333ec24df0adb82ea8e2db86d4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:59.406245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:59.407894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:59.421920 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eef650-6d77-4296-ae93-8ae69d67b293 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:59.514032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:59.515159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:59.515515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:59.515979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] PATH_INFO: `/v3/projects/9ca629ec31be451692eb070655ade9ff` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:59.517307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca629ec31be451692eb070655ade9ff)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:59.519395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:59.575730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca629ec31be451692eb070655ade9ff', 'request_id': 'req-4b2168c9-e2a1-4543-9770-16c047b62a19'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.582945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca629ec31be451692eb070655ade9ff', 'request_id': 'req-4b2168c9-e2a1-4543-9770-16c047b62a19'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.593886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca629ec31be451692eb070655ade9ff', 'request_id': 'req-4b2168c9-e2a1-4543-9770-16c047b62a19'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.606554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] The token cache is being invalidate because project 9ca629ec31be451692eb070655ade9ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:44:59.606963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.607661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b2168c9-e2a1-4543-9770-16c047b62a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:44:59.609307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1125/2233] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:44:59 2022] DELETE /identity/v3/projects/9ca629ec31be451692eb070655ade9ff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:44:59.614419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb842cf-e000-45a0-8774-ad360d51bde5 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:59.614893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb842cf-e000-45a0-8774-ad360d51bde5 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:59.615205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb842cf-e000-45a0-8774-ad360d51bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:59.634779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-9bb842cf-e000-45a0-8774-ad360d51bde5 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:59.636051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9bb842cf-e000-45a0-8774-ad360d51bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:59.722641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1109/2234] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:44:59.730854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae327f-3312-4a8c-95bf-92e86a16cd11 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:59.731239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae327f-3312-4a8c-95bf-92e86a16cd11 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:59.731584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae327f-3312-4a8c-95bf-92e86a16cd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:59.752070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c4ae327f-3312-4a8c-95bf-92e86a16cd11 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:44:59.753533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c4ae327f-3312-4a8c-95bf-92e86a16cd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:44:59.761937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1126/2235] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:44:59.766304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb842cf-e000-45a0-8774-ad360d51bde5 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:59.777682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb842cf-e000-45a0-8774-ad360d51bde5 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:59.784813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:59.785571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:59.785922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:59.786279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:59.787088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:44:59.787459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:59.789172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:59.805678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1110/2236] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:44:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:44:59.806847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae327f-3312-4a8c-95bf-92e86a16cd11 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:59.816568 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae327f-3312-4a8c-95bf-92e86a16cd11 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:59.821692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6fc4f-7547-4947-ae48-e9d0cd190b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:59.822367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6fc4f-7547-4947-ae48-e9d0cd190b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:59.822651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6fc4f-7547-4947-ae48-e9d0cd190b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:59.822928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb6fc4f-7547-4947-ae48-e9d0cd190b05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:59.823650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6fc4f-7547-4947-ae48-e9d0cd190b05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:59.825566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb6fc4f-7547-4947-ae48-e9d0cd190b05 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:59.859341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1127/2237] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:44:59 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:44:59.860728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:59.871748 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df037665-74a2-4011-8a48-a383d023f097 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:59.888016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:44:59.935771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517af16-d9ea-4c13-b06b-4fcd46860aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:59.936368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517af16-d9ea-4c13-b06b-4fcd46860aca admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:59.936649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517af16-d9ea-4c13-b06b-4fcd46860aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:59.936924 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517af16-d9ea-4c13-b06b-4fcd46860aca admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:44:59.937616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517af16-d9ea-4c13-b06b-4fcd46860aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:44:59.939555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6517af16-d9ea-4c13-b06b-4fcd46860aca admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:44:59.961419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1111/2238] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:44:59 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:44:59.966014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6fc4f-7547-4947-ae48-e9d0cd190b05 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:44:59.980907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb6fc4f-7547-4947-ae48-e9d0cd190b05 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:44:59.986487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f9f12-d4a5-485b-94ad-1e43a3e19964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:44:59.987721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f9f12-d4a5-485b-94ad-1e43a3e19964 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:44:59.997344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f9f12-d4a5-485b-94ad-1e43a3e19964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:44:59.997344 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f9f12-d4a5-485b-94ad-1e43a3e19964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:00.000495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f9f12-d4a5-485b-94ad-1e43a3e19964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:00.002035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f9f12-d4a5-485b-94ad-1e43a3e19964 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:00.035142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1128/2239] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:45:00.039393 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517af16-d9ea-4c13-b06b-4fcd46860aca admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:00.054355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6517af16-d9ea-4c13-b06b-4fcd46860aca admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:00.059414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df95fac-3d6e-4e28-84c2-d0231fd5de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:00.060124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95fac-3d6e-4e28-84c2-d0231fd5de41 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:00.060408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95fac-3d6e-4e28-84c2-d0231fd5de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:00.060683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df95fac-3d6e-4e28-84c2-d0231fd5de41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:00.061423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df95fac-3d6e-4e28-84c2-d0231fd5de41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:00.063101 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df95fac-3d6e-4e28-84c2-d0231fd5de41 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:00.075098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1112/2240] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:45:00.081118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f9f12-d4a5-485b-94ad-1e43a3e19964 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:00.095657 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f9f12-d4a5-485b-94ad-1e43a3e19964 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:00.098708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:00.099690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:00.099928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:00.100265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] PATH_INFO: `/v3/projects/f1c321c70984445ba5a4f399a45120e0/users/163ec3443d3c4ef395b6acc27265448b/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:00.118166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1c321c70984445ba5a4f399a45120e0, user_id=163ec3443d3c4ef395b6acc27265448b, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:00.121030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:00.138058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1129/2241] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:45:00 2022] PUT /identity/v3/projects/f1c321c70984445ba5a4f399a45120e0/users/163ec3443d3c4ef395b6acc27265448b/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:45:00.151110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec56c8-b8e5-4313-8709-35d5fb26842c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:00.151470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec56c8-b8e5-4313-8709-35d5fb26842c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:00.151887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec56c8-b8e5-4313-8709-35d5fb26842c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:00.185405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3eec56c8-b8e5-4313-8709-35d5fb26842c None None] MFA Rules not processed for user `163ec3443d3c4ef395b6acc27265448b`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:00.186845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3eec56c8-b8e5-4313-8709-35d5fb26842c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:00.280801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1113/2242] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:45:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:45:00.288647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:00.290832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:00.323200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:00.384290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827428e-9b8b-4f34-bb8f-b7791bd25664 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:00.389445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec664bc-73f2-4f65-859d-658a6ababc2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:00.390104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec664bc-73f2-4f65-859d-658a6ababc2a service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:00.390386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec664bc-73f2-4f65-859d-658a6ababc2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:00.390798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec664bc-73f2-4f65-859d-658a6ababc2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:00.400183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec664bc-73f2-4f65-859d-658a6ababc2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:00.401652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec664bc-73f2-4f65-859d-658a6ababc2a service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:00.413360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1130/2243] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:45:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:45:00.435036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec56c8-b8e5-4313-8709-35d5fb26842c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:00.512311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec56c8-b8e5-4313-8709-35d5fb26842c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:00.517446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:00.518597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:00.519009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:00.519409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] PATH_INFO: `/v3/users/163ec3443d3c4ef395b6acc27265448b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:00.520793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=163ec3443d3c4ef395b6acc27265448b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:00.522839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:00.557416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:00.581394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '163ec3443d3c4ef395b6acc27265448b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:00.591260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '163ec3443d3c4ef395b6acc27265448b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:00.592068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '163ec3443d3c4ef395b6acc27265448b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:00.605157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '163ec3443d3c4ef395b6acc27265448b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:00.622622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '163ec3443d3c4ef395b6acc27265448b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:00.630010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1114/2244] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:45:00 2022] DELETE /identity/v3/users/163ec3443d3c4ef395b6acc27265448b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:45:00.637302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93741c0b-4e6a-4b6f-b6fa-6badb9befad6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:00.637807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93741c0b-4e6a-4b6f-b6fa-6badb9befad6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:00.638407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93741c0b-4e6a-4b6f-b6fa-6badb9befad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:00.663953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-93741c0b-4e6a-4b6f-b6fa-6badb9befad6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:00.667091 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-93741c0b-4e6a-4b6f-b6fa-6badb9befad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:00.735443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1131/2245] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:45:00.746419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:00.748037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:00.813933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0cbaef-6baa-4186-ba5c-a7f466d950b6 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:00.818456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:00.819196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:00.819547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:00.819919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:00.833359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:00.834813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:00.846520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1115/2246] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:45:01.198003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc786-987a-437e-b723-e968be167663 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:01.198573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc786-987a-437e-b723-e968be167663 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:01.198826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc786-987a-437e-b723-e968be167663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:01.220430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-dbafc786-987a-437e-b723-e968be167663 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:01.220914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:01.221976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dbafc786-987a-437e-b723-e968be167663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:01.225043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:01.240316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1132/2247] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:45:01.247959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dcecf5-9a3b-4792-93b9-4ba34b32c194 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:01.255349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:01.256592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:01.257033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:01.258084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] PATH_INFO: `/v3/projects/f1c321c70984445ba5a4f399a45120e0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:01.259628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1c321c70984445ba5a4f399a45120e0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:01.261700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:01.264612 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc786-987a-437e-b723-e968be167663 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:01.266411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dbafc786-987a-437e-b723-e968be167663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:01.332465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1c321c70984445ba5a4f399a45120e0', 'request_id': 'req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:01.345470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1c321c70984445ba5a4f399a45120e0', 'request_id': 'req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:01.352718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1c321c70984445ba5a4f399a45120e0', 'request_id': 'req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:01.368953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] The token cache is being invalidate because project f1c321c70984445ba5a4f399a45120e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:45:01.369415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:01.370206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5c0dfbaa-b0d9-4132-beb8-7790c027e1ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:45:01.372422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1116/2248] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:45:01 2022] DELETE /identity/v3/projects/f1c321c70984445ba5a4f399a45120e0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:45:01.389202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc786-987a-437e-b723-e968be167663 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:01.477039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:01.498701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:01.499732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:01.500182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:01.500609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:01.503215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:01.606442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:01.611835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:01.624517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1133/2249] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:45:06.450487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034b1b-2923-4609-b104-29879042a54d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:06.451046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034b1b-2923-4609-b104-29879042a54d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:06.451046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44034b1b-2923-4609-b104-29879042a54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:06.472797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-44034b1b-2923-4609-b104-29879042a54d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:06.474225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-44034b1b-2923-4609-b104-29879042a54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:06.483711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1117/2250] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:45:06.507139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:06.509432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:06.526696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56134385-73b5-40ab-ac02-615d2b93165b service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:06.533368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d3b29e-52b5-4d87-97ef-b46991fa203a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:06.534030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3b29e-52b5-4d87-97ef-b46991fa203a service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:06.534309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3b29e-52b5-4d87-97ef-b46991fa203a service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:06.534591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d3b29e-52b5-4d87-97ef-b46991fa203a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:06.543178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3b29e-52b5-4d87-97ef-b46991fa203a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:06.544792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d3b29e-52b5-4d87-97ef-b46991fa203a service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:06.554735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1134/2251] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:45:10.542071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ef79e-a8f1-45de-bc09-1b8f62806a5d None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:10.542621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ef79e-a8f1-45de-bc09-1b8f62806a5d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:10.542621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ef79e-a8f1-45de-bc09-1b8f62806a5d None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:10.543993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1118/2252] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:45:10.549659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761240-beb2-403f-8606-da9cc7feb61f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:10.550108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761240-beb2-403f-8606-da9cc7feb61f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:10.550395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761240-beb2-403f-8606-da9cc7feb61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:10.569839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-13761240-beb2-403f-8606-da9cc7feb61f None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:10.571053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-13761240-beb2-403f-8606-da9cc7feb61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:10.580494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1135/2253] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:45:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:45:10.592141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ef79e-a8f1-45de-bc09-1b8f62806a5d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:10.593796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a13ef79e-a8f1-45de-bc09-1b8f62806a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:10.622601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:10.663749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ef79e-a8f1-45de-bc09-1b8f62806a5d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:10.667349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611b260-9351-446e-9bc4-fc16ae7eadd1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:10.668057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b260-9351-446e-9bc4-fc16ae7eadd1 service glance] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:10.668338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b260-9351-446e-9bc4-fc16ae7eadd1 service glance] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:10.668613 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611b260-9351-446e-9bc4-fc16ae7eadd1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:10.679764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b260-9351-446e-9bc4-fc16ae7eadd1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:10.681459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611b260-9351-446e-9bc4-fc16ae7eadd1 service glance] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:10.693562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1119/2254] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:45:10.764249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ccf36-4a27-430b-9b6e-6e8503da20a1 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:10.764495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ccf36-4a27-430b-9b6e-6e8503da20a1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:10.764851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ccf36-4a27-430b-9b6e-6e8503da20a1 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:10.766946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1136/2255] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 13:45:10.774005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2ca64-5431-449d-9937-4966bef58902 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:10.774495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2ca64-5431-449d-9937-4966bef58902 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:10.775023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2ca64-5431-449d-9937-4966bef58902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:10.799043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e7b2ca64-5431-449d-9937-4966bef58902 None None] MFA Rules not processed for user `bcdda7fcb39248c1a5a36ee699d23c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:10.800280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e7b2ca64-5431-449d-9937-4966bef58902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:10.853705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1120/2256] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:45:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:45:10.867193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ccf36-4a27-430b-9b6e-6e8503da20a1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:10.869235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1d6ccf36-4a27-430b-9b6e-6e8503da20a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:10.882848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ccf36-4a27-430b-9b6e-6e8503da20a1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:10.887411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d23e5f-908e-4497-8fb0-b820f775ad39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:10.888190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23e5f-908e-4497-8fb0-b820f775ad39 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:10.888513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23e5f-908e-4497-8fb0-b820f775ad39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:10.888816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d23e5f-908e-4497-8fb0-b820f775ad39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:10.896708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d23e5f-908e-4497-8fb0-b820f775ad39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:10.898152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d23e5f-908e-4497-8fb0-b820f775ad39 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:10.906454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1137/2257] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:45:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:45:10.997337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194ba6-7f4e-4618-8137-f68a5b8c6ce1 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:10.997633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194ba6-7f4e-4618-8137-f68a5b8c6ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:10.997910 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52194ba6-7f4e-4618-8137-f68a5b8c6ce1 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:10.999313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1121/2258] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:45:11.004913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f75f9-50f6-4d49-b4fc-8cf89507e6f8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:11.005197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f75f9-50f6-4d49-b4fc-8cf89507e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:11.005466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f75f9-50f6-4d49-b4fc-8cf89507e6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:11.025305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7a6f75f9-50f6-4d49-b4fc-8cf89507e6f8 None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:11.026487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7a6f75f9-50f6-4d49-b4fc-8cf89507e6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:11.036674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1138/2259] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:45:11.047134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52194ba6-7f4e-4618-8137-f68a5b8c6ce1 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:11.049230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-52194ba6-7f4e-4618-8137-f68a5b8c6ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:11.063775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52194ba6-7f4e-4618-8137-f68a5b8c6ce1 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:11.067627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:11.068625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:11.068901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:11.069174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:11.079710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:11.081141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:11.091944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1122/2260] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:45:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:45:11.673279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7918b2b-a30d-482b-ae8a-af688f62c1ff None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:11.673801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7918b2b-a30d-482b-ae8a-af688f62c1ff None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:11.673961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7918b2b-a30d-482b-ae8a-af688f62c1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:11.695941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b7918b2b-a30d-482b-ae8a-af688f62c1ff None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:11.697346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b7918b2b-a30d-482b-ae8a-af688f62c1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:11.707065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1139/2261] 10.222.0.67 () {58 vars in 1016 bytes} [Tue Jul 12 13:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:45:11.733158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:11.734480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:11.750228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfa017-bda8-468b-ac82-efd9da1e44f2 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:11.756298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:11.756956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:11.757503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:11.757613 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:11.766569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:11.768230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:11.778954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1123/2262] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:45:15.551100 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bebe-5656-4efe-bdd7-420b76ebaecb None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:15.551518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bebe-5656-4efe-bdd7-420b76ebaecb None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:15.551669 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9bebe-5656-4efe-bdd7-420b76ebaecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:15.570763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b5e9bebe-5656-4efe-bdd7-420b76ebaecb None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:15.572065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b5e9bebe-5656-4efe-bdd7-420b76ebaecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:15.632930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1140/2263] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:45:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:45:15.645121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:15.646584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:15.722715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f532399-18d4-4f10-a5c3-46521dc8ac75 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:15.729705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a54307-fd36-4c41-9345-642f590f14b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:15.730755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a54307-fd36-4c41-9345-642f590f14b4 service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:15.731233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a54307-fd36-4c41-9345-642f590f14b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:15.731761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a54307-fd36-4c41-9345-642f590f14b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:15.745209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a54307-fd36-4c41-9345-642f590f14b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:15.746762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a54307-fd36-4c41-9345-642f590f14b4 service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:15.755791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1124/2264] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:45:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:45:25.625594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=79 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:25.752171 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=82 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:45.344826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5960-a66c-41d6-8e08-1d4423aa5233 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:45.345412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5960-a66c-41d6-8e08-1d4423aa5233 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:45.345412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d5960-a66c-41d6-8e08-1d4423aa5233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:45.364378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b65d5960-a66c-41d6-8e08-1d4423aa5233 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:45:45.367304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b65d5960-a66c-41d6-8e08-1d4423aa5233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:45:45.373810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1141/2265] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 12 13:45:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:45:45.395517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a54307-fd36-4c41-9345-642f590f14b4 service swift] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:45:45.408974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a54307-fd36-4c41-9345-642f590f14b4 service swift] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:45:45.416431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed5f1-01f1-4492-944b-b7551dbdbbc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:45:45.417628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed5f1-01f1-4492-944b-b7551dbdbbc9 service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:45:45.418262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed5f1-01f1-4492-944b-b7551dbdbbc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:45:45.418926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ed5f1-01f1-4492-944b-b7551dbdbbc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:45:45.430542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed5f1-01f1-4492-944b-b7551dbdbbc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:45:45.432135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ed5f1-01f1-4492-944b-b7551dbdbbc9 service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:45:45.441369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1125/2266] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:45:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:45:55.359179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:45:55.438060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=6 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:06.419195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5960-a66c-41d6-8e08-1d4423aa5233 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:06.421501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b65d5960-a66c-41d6-8e08-1d4423aa5233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:06.442981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d5960-a66c-41d6-8e08-1d4423aa5233 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:06.449593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:06.451348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:06.452072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:06.452397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] PATH_INFO: `/v3/users/09a69bba369d4037ae66e240eb8e556b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:06.453902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a69bba369d4037ae66e240eb8e556b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:06.456192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:06.507381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a69bba369d4037ae66e240eb8e556b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.508089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a69bba369d4037ae66e240eb8e556b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.516160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a69bba369d4037ae66e240eb8e556b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.523342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a69bba369d4037ae66e240eb8e556b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.524011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-da909b2d-ba8b-48ca-859e-6d6059232d24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a69bba369d4037ae66e240eb8e556b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.542509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1142/2267] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:46:06 2022] DELETE /identity/v3/users/09a69bba369d4037ae66e240eb8e556b => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:46:06.727394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed5f1-01f1-4492-944b-b7551dbdbbc9 service swift] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:06.747857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ed5f1-01f1-4492-944b-b7551dbdbbc9 service swift] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:06.814209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:06.815084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:06.815371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:06.815685 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] PATH_INFO: `/v3/projects/076373845ff3474095725063f8a3b5d0` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:06.816874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=076373845ff3474095725063f8a3b5d0)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:06.819112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:06.866266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '076373845ff3474095725063f8a3b5d0', 'request_id': 'req-5d049a7a-1631-480f-bd17-50784c5b2a74'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.874868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '076373845ff3474095725063f8a3b5d0', 'request_id': 'req-5d049a7a-1631-480f-bd17-50784c5b2a74'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.881766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '076373845ff3474095725063f8a3b5d0', 'request_id': 'req-5d049a7a-1631-480f-bd17-50784c5b2a74'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.893055 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] The token cache is being invalidate because project 076373845ff3474095725063f8a3b5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:46:06.893334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.894051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5d049a7a-1631-480f-bd17-50784c5b2a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:06.895761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1126/2268] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:46:06 2022] DELETE /identity/v3/projects/076373845ff3474095725063f8a3b5d0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:46:06.900890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38146c-b76d-4017-bc57-42bdcc1466db None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:06.901130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38146c-b76d-4017-bc57-42bdcc1466db None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:06.901396 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38146c-b76d-4017-bc57-42bdcc1466db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:06.919912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6f38146c-b76d-4017-bc57-42bdcc1466db None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:46:06.921111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6f38146c-b76d-4017-bc57-42bdcc1466db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:06.983717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1143/2269] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:46:07.049197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecd4d-7342-44af-abba-79ecb30494c2 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.049480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecd4d-7342-44af-abba-79ecb30494c2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.049745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ecd4d-7342-44af-abba-79ecb30494c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.069270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d65ecd4d-7342-44af-abba-79ecb30494c2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:46:07.070475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d65ecd4d-7342-44af-abba-79ecb30494c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:07.082899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1127/2270] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:46:07.089454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38146c-b76d-4017-bc57-42bdcc1466db None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:07.104107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38146c-b76d-4017-bc57-42bdcc1466db None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:07.108887 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:07.109547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.109826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.110097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.110830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:46:07.111136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:07.112766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:07.126803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1144/2271] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:46:07.131001 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ecd4d-7342-44af-abba-79ecb30494c2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:07.141278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ecd4d-7342-44af-abba-79ecb30494c2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:07.146294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c4496-5fbb-4c06-8cf8-90055b04d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:07.146947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4496-5fbb-4c06-8cf8-90055b04d363 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.147231 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4496-5fbb-4c06-8cf8-90055b04d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.147567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c4496-5fbb-4c06-8cf8-90055b04d363 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.148306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c4496-5fbb-4c06-8cf8-90055b04d363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:07.150305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c4496-5fbb-4c06-8cf8-90055b04d363 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:07.180223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1128/2272] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:46:07 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:46:07.184345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:07.194998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a334bd32-a32b-48a2-8ca5-215a21259c95 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:07.256706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79037660-5403-45c8-80a6-52e056220861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:07.257383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037660-5403-45c8-80a6-52e056220861 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.257667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037660-5403-45c8-80a6-52e056220861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.257948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79037660-5403-45c8-80a6-52e056220861 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.258655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79037660-5403-45c8-80a6-52e056220861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:07.260628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79037660-5403-45c8-80a6-52e056220861 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:07.267388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:07.283811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1145/2273] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:46:07 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:46:07.287858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c4496-5fbb-4c06-8cf8-90055b04d363 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:07.300537 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c4496-5fbb-4c06-8cf8-90055b04d363 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:07.307722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117835cf-626c-41c6-a060-5faaa50afb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:07.308397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117835cf-626c-41c6-a060-5faaa50afb6c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.308682 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117835cf-626c-41c6-a060-5faaa50afb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.308959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117835cf-626c-41c6-a060-5faaa50afb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.309693 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117835cf-626c-41c6-a060-5faaa50afb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:07.312184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117835cf-626c-41c6-a060-5faaa50afb6c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:07.323927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1129/2274] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:46:07.328009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79037660-5403-45c8-80a6-52e056220861 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:07.338298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79037660-5403-45c8-80a6-52e056220861 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:07.343215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74151708-2593-4aa1-9260-bce60683d7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:07.343947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74151708-2593-4aa1-9260-bce60683d7ff admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.344232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74151708-2593-4aa1-9260-bce60683d7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.344515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74151708-2593-4aa1-9260-bce60683d7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.345262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74151708-2593-4aa1-9260-bce60683d7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:07.346852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74151708-2593-4aa1-9260-bce60683d7ff admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:07.357613 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1146/2275] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:46:07.361275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117835cf-626c-41c6-a060-5faaa50afb6c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:07.371538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117835cf-626c-41c6-a060-5faaa50afb6c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:07.376645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:07.377498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.377776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.378052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] PATH_INFO: `/v3/projects/7e3f369bd6c14dafbc440eeb26980f6b/users/fd71fd0bf63f41f3bfc016b1046a61fe/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.393014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3f369bd6c14dafbc440eeb26980f6b, user_id=fd71fd0bf63f41f3bfc016b1046a61fe, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:07.395707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:07.412365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1130/2276] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:46:07 2022] PUT /identity/v3/projects/7e3f369bd6c14dafbc440eeb26980f6b/users/fd71fd0bf63f41f3bfc016b1046a61fe/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:46:07.422839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610033b-5592-4fb0-abad-5b354ffd33d7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.423322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610033b-5592-4fb0-abad-5b354ffd33d7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.423427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8610033b-5592-4fb0-abad-5b354ffd33d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.451303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8610033b-5592-4fb0-abad-5b354ffd33d7 None None] MFA Rules not processed for user `fd71fd0bf63f41f3bfc016b1046a61fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:46:07.452490 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8610033b-5592-4fb0-abad-5b354ffd33d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:07.517688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1147/2277] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:46:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:46:07.529530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:07.531445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:07.563876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:07.591843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a037ad-b5b9-458f-af1e-1958e79aa234 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:07.595916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01176918-790d-47ba-a671-dad434b7e653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:07.596661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176918-790d-47ba-a671-dad434b7e653 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:07.596940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176918-790d-47ba-a671-dad434b7e653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:07.597219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01176918-790d-47ba-a671-dad434b7e653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:07.606060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01176918-790d-47ba-a671-dad434b7e653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:07.607515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01176918-790d-47ba-a671-dad434b7e653 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:07.616530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1131/2278] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:46:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:46:12.583472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610033b-5592-4fb0-abad-5b354ffd33d7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:12.652884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8610033b-5592-4fb0-abad-5b354ffd33d7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:12.658802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:12.659776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:12.660193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:12.660473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] PATH_INFO: `/v3/users/fd71fd0bf63f41f3bfc016b1046a61fe` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:12.661786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd71fd0bf63f41f3bfc016b1046a61fe)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:12.663814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:12.714458 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd71fd0bf63f41f3bfc016b1046a61fe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:12.715124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd71fd0bf63f41f3bfc016b1046a61fe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:12.722842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd71fd0bf63f41f3bfc016b1046a61fe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:12.729868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd71fd0bf63f41f3bfc016b1046a61fe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:12.730525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd71fd0bf63f41f3bfc016b1046a61fe'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:12.735557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:12.749632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1148/2279] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:46:12 2022] DELETE /identity/v3/users/fd71fd0bf63f41f3bfc016b1046a61fe => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:46:12.754241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b58d-2665-48c9-9c41-1101d9ee1b96 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:12.754735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b58d-2665-48c9-9c41-1101d9ee1b96 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:12.754840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b58d-2665-48c9-9c41-1101d9ee1b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:12.772473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-4978b58d-2665-48c9-9c41-1101d9ee1b96 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:46:12.773695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4978b58d-2665-48c9-9c41-1101d9ee1b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:12.846245 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1132/2280] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:46:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:46:12.861095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:12.863328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:12.928628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903e86f-ecb5-4d81-945f-21c2340eb8af admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:12.932498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fda9f3-fc7a-4b82-80ce-a9aa61602b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:12.933156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda9f3-fc7a-4b82-80ce-a9aa61602b67 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:12.933438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda9f3-fc7a-4b82-80ce-a9aa61602b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:12.933717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fda9f3-fc7a-4b82-80ce-a9aa61602b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:12.942790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fda9f3-fc7a-4b82-80ce-a9aa61602b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:12.944602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fda9f3-fc7a-4b82-80ce-a9aa61602b67 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:12.955699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1149/2281] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:46:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:46:13.263671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b58d-2665-48c9-9c41-1101d9ee1b96 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:13.265700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4978b58d-2665-48c9-9c41-1101d9ee1b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:13.281838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b58d-2665-48c9-9c41-1101d9ee1b96 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:13.288361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:13.289239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:13.289485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:13.289722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] PATH_INFO: `/v3/projects/7e3f369bd6c14dafbc440eeb26980f6b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:13.291064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3f369bd6c14dafbc440eeb26980f6b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:13.293012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:13.342280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3f369bd6c14dafbc440eeb26980f6b', 'request_id': 'req-f4ab3451-ee37-41cd-9692-32fb8864dc96'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:13.350639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3f369bd6c14dafbc440eeb26980f6b', 'request_id': 'req-f4ab3451-ee37-41cd-9692-32fb8864dc96'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:13.357068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3f369bd6c14dafbc440eeb26980f6b', 'request_id': 'req-f4ab3451-ee37-41cd-9692-32fb8864dc96'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:13.368490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] The token cache is being invalidate because project 7e3f369bd6c14dafbc440eeb26980f6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:46:13.368778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:13.369501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:46:13.371086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1133/2282] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:46:13 2022] DELETE /identity/v3/projects/7e3f369bd6c14dafbc440eeb26980f6b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:46:22.951148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=31,keystone:DELETE=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:23.365281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:28.365174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fda9f3-fc7a-4b82-80ce-a9aa61602b67 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:28.374473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fda9f3-fc7a-4b82-80ce-a9aa61602b67 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:28.429595 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7374d-a509-4f59-8ef1-885742a8b764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:28.430460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7374d-a509-4f59-8ef1-885742a8b764 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:28.430981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7374d-a509-4f59-8ef1-885742a8b764 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:28.431363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7374d-a509-4f59-8ef1-885742a8b764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:28.434358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-83a7374d-a509-4f59-8ef1-885742a8b764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:28.520691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7374d-a509-4f59-8ef1-885742a8b764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:28.522092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7374d-a509-4f59-8ef1-885742a8b764 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:28.533289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1150/2283] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:46:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:46:28.624184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:28.625640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:28.638002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3451-ee37-41cd-9692-32fb8864dc96 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:28.641669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:28.642333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:28.642613 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:28.642883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:28.644774 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:28.664906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:28.666478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:28.677861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1134/2284] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:46:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:46:33.577948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d14a-d373-43c5-a339-f97d4a87e6a7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:33.578532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d14a-d373-43c5-a339-f97d4a87e6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:33.578532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d14a-d373-43c5-a339-f97d4a87e6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:33.598729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c8c8d14a-d373-43c5-a339-f97d4a87e6a7 None None] MFA Rules not processed for user `2eb98f1b1bf440ba8c3d10894f5518be`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:46:33.599986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c8c8d14a-d373-43c5-a339-f97d4a87e6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:33.659159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1151/2285] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:46:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:46:38.672606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=6 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:43.650558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=79 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:46:43.651677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:43.653277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:43.668049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e2670-6abb-45a3-94c8-ca127389b83b service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:43.675070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:43.675777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:43.676058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:43.676342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:43.678484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:43.738443 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:43.740061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:43.749155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1135/2286] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:46:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:46:45.953045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbf5f5-a929-4789-87cf-f024fbfbf785 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:45.953608 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbf5f5-a929-4789-87cf-f024fbfbf785 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:45.953608 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dbf5f5-a929-4789-87cf-f024fbfbf785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:45.972580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c6dbf5f5-a929-4789-87cf-f024fbfbf785 None None] MFA Rules not processed for user `636181e787714128869124b40ab14c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:46:45.973808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c6dbf5f5-a929-4789-87cf-f024fbfbf785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:45.981715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1152/2287] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:46:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:46:53.533664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:46:53.535375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:53.551118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc42f4-0b55-4322-a5b8-a306ed541db3 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:46:53.558068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b09fbc-8c46-43fa-b585-1bb4fddeab97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:46:53.558728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09fbc-8c46-43fa-b585-1bb4fddeab97 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:46:53.559013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09fbc-8c46-43fa-b585-1bb4fddeab97 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:46:53.559284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b09fbc-8c46-43fa-b585-1bb4fddeab97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:46:53.561327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-50b09fbc-8c46-43fa-b585-1bb4fddeab97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:46:53.622680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b09fbc-8c46-43fa-b585-1bb4fddeab97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:46:53.624350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b09fbc-8c46-43fa-b585-1bb4fddeab97 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:46:53.633638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1136/2288] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:46:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:46:55.966772 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:01.541952 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbf5f5-a929-4789-87cf-f024fbfbf785 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:47:01.543768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c6dbf5f5-a929-4789-87cf-f024fbfbf785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:01.559429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dbf5f5-a929-4789-87cf-f024fbfbf785 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:47:01.564116 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:47:01.564874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:47:01.565233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:47:01.565571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:47:01.567817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:01.578906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:47:01.580394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:47:01.589672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1153/2289] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:47:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:47:02.521771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe7a4-9f01-48ad-8032-3cee6ecfbb17 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:47:02.522478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe7a4-9f01-48ad-8032-3cee6ecfbb17 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:47:02.522478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe7a4-9f01-48ad-8032-3cee6ecfbb17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:47:02.545263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-dfafe7a4-9f01-48ad-8032-3cee6ecfbb17 None None] MFA Rules not processed for user `0b6134cfb9cf44a9bc86f6c639283b24`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:47:02.546480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-dfafe7a4-9f01-48ad-8032-3cee6ecfbb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:02.554266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1137/2290] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:47:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:47:02.879020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:47:02.888457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f0d81-6ad9-45e4-9250-f7941e5c1ee0 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:47:02.893142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:47:02.893802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:47:02.894082 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:47:02.894356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:47:02.896578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:02.906658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:47:02.908067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:47:02.915867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1154/2291] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:47:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:47:03.243500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafe7a4-9f01-48ad-8032-3cee6ecfbb17 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:47:03.245294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-dfafe7a4-9f01-48ad-8032-3cee6ecfbb17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:03.320567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafe7a4-9f01-48ad-8032-3cee6ecfbb17 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:47:03.325630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:47:03.326352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:47:03.326637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:47:03.326943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:47:03.328837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:03.339942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:47:03.341564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:47:03.351887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1138/2292] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:47:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:47:12.912688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=12 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:13.347564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=91 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:16.566714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:47:16.581539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d94010-ea9e-49d8-96b1-0873832df178 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:47:16.588356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:47:16.589022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:47:16.589308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:47:16.589586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:47:16.591549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:16.604445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:47:16.606060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:47:16.617701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1155/2293] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:47:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:47:26.613860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:40.086953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:47:40.088776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:40.147567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b3f9f-f0bb-499e-b48d-55f6bdf86018 service placement] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:47:40.151706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485dbd-e5a3-467e-8f21-3fb49920ffba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:47:40.152346 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485dbd-e5a3-467e-8f21-3fb49920ffba service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:47:40.152623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485dbd-e5a3-467e-8f21-3fb49920ffba service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:47:40.152894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485dbd-e5a3-467e-8f21-3fb49920ffba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:47:40.154792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-af485dbd-e5a3-467e-8f21-3fb49920ffba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:40.215104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af485dbd-e5a3-467e-8f21-3fb49920ffba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:47:40.216591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af485dbd-e5a3-467e-8f21-3fb49920ffba service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:47:40.226925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1139/2294] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:47:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:47:45.195534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:47:45.205804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a32bbb-1418-4097-ad3a-c0518d38f7c0 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:47:45.209859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:47:45.210626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:47:45.210914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:47:45.211185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:47:45.213315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:45.225594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:47:45.227104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:47:45.237086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1156/2295] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:47:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:47:45.961370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18af95-7c2a-4c94-a927-761649fed118 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:47:45.961896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18af95-7c2a-4c94-a927-761649fed118 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:47:45.961896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18af95-7c2a-4c94-a927-761649fed118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:47:45.981337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-4d18af95-7c2a-4c94-a927-761649fed118 None None] MFA Rules not processed for user `0c10f3ffc56c4743b65e55a8936bc0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:47:45.982600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4d18af95-7c2a-4c94-a927-761649fed118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:47:45.999577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1140/2296] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:47:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:47:55.233200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:47:55.974641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=51 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:00.560564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:00.575770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d729a-63cb-43c5-826e-41163868cfc6 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:00.582274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:00.583123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:00.583409 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:00.583751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:00.585848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:00.600231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:00.602025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:00.616346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1157/2297] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:06.293880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18af95-7c2a-4c94-a927-761649fed118 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:06.304361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18af95-7c2a-4c94-a927-761649fed118 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:06.308733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:06.309538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:06.309882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:06.310235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:06.312306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:06.376635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:06.378072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:06.388606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1141/2298] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:09.805343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:09.806872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:09.821180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b33643-b1f8-49a5-984b-0f3a02005bb5 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:09.826065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:09.826955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:09.827235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:09.827510 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] PATH_INFO: `/v3/users/2eb98f1b1bf440ba8c3d10894f5518be` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:09.828866 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb98f1b1bf440ba8c3d10894f5518be)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:09.830762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:09.880970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb98f1b1bf440ba8c3d10894f5518be'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:09.881655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb98f1b1bf440ba8c3d10894f5518be'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:09.889911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb98f1b1bf440ba8c3d10894f5518be'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:09.897156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb98f1b1bf440ba8c3d10894f5518be'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:09.897800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cd56900-35a3-4d68-8db6-45c8ce829317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb98f1b1bf440ba8c3d10894f5518be'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:09.915738 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1158/2299] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:09 2022] DELETE /identity/v3/users/2eb98f1b1bf440ba8c3d10894f5518be => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:10.102399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:10.118107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5975db6-07c2-42b6-8a3c-fcdf393e39e7 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:10.174968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:10.175863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.176144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.176418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] PATH_INFO: `/v3/projects/b554e8d81aba49928903563d4db30e63` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.177620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b554e8d81aba49928903563d4db30e63)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:10.179542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:10.228550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b554e8d81aba49928903563d4db30e63', 'request_id': 'req-6248f2c6-0fc3-4e12-a010-28072ab0b136'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:10.236943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b554e8d81aba49928903563d4db30e63', 'request_id': 'req-6248f2c6-0fc3-4e12-a010-28072ab0b136'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:10.242618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b554e8d81aba49928903563d4db30e63', 'request_id': 'req-6248f2c6-0fc3-4e12-a010-28072ab0b136'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:10.253527 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] The token cache is being invalidate because project b554e8d81aba49928903563d4db30e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:10.253813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:10.254453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6248f2c6-0fc3-4e12-a010-28072ab0b136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:10.256093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1142/2300] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:10 2022] DELETE /identity/v3/projects/b554e8d81aba49928903563d4db30e63 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:10.262420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af06fe-dbfe-41c0-b437-5824f625dc2b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.262711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af06fe-dbfe-41c0-b437-5824f625dc2b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.262983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af06fe-dbfe-41c0-b437-5824f625dc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.282557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e9af06fe-dbfe-41c0-b437-5824f625dc2b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:10.283806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e9af06fe-dbfe-41c0-b437-5824f625dc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:10.346248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1159/2301] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:10.354037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f553d2-642f-4307-8eec-99690ba9d4ca None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.354300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f553d2-642f-4307-8eec-99690ba9d4ca None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.354576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f553d2-642f-4307-8eec-99690ba9d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.374305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-39f553d2-642f-4307-8eec-99690ba9d4ca None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:10.375541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-39f553d2-642f-4307-8eec-99690ba9d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:10.385051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1143/2302] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:10.389272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af06fe-dbfe-41c0-b437-5824f625dc2b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:10.399533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af06fe-dbfe-41c0-b437-5824f625dc2b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:10.405606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:10.406261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.406541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.406808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.407559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:48:10.407890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:10.409504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:10.421378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1160/2303] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:48:10.425587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f553d2-642f-4307-8eec-99690ba9d4ca None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:10.434875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f553d2-642f-4307-8eec-99690ba9d4ca None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:10.439983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa52b8-3ff6-48bb-ad9a-b72a9d7b097a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:10.440623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa52b8-3ff6-48bb-ad9a-b72a9d7b097a admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.440902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa52b8-3ff6-48bb-ad9a-b72a9d7b097a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.441170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaa52b8-3ff6-48bb-ad9a-b72a9d7b097a admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.441863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa52b8-3ff6-48bb-ad9a-b72a9d7b097a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:10.443779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaa52b8-3ff6-48bb-ad9a-b72a9d7b097a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:10.458380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:10.476040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1144/2304] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:10 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:10.477153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:10.487673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8889d0e-af20-4c0d-a199-10d24779ebd2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:10.530900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:10.544787 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880eb23-8a0c-4a98-9d8a-7d386dd60b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:10.545455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880eb23-8a0c-4a98-9d8a-7d386dd60b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.545732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880eb23-8a0c-4a98-9d8a-7d386dd60b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.546004 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880eb23-8a0c-4a98-9d8a-7d386dd60b14 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.546688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880eb23-8a0c-4a98-9d8a-7d386dd60b14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:10.548649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880eb23-8a0c-4a98-9d8a-7d386dd60b14 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:10.570343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1161/2305] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:10 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:10.575009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa52b8-3ff6-48bb-ad9a-b72a9d7b097a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:10.585818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaa52b8-3ff6-48bb-ad9a-b72a9d7b097a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:10.591371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c626c-c121-4bb4-adf1-21d39fe52b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:10.592063 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c626c-c121-4bb4-adf1-21d39fe52b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.592362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c626c-c121-4bb4-adf1-21d39fe52b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.592633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518c626c-c121-4bb4-adf1-21d39fe52b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.593340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c626c-c121-4bb4-adf1-21d39fe52b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:10.594957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518c626c-c121-4bb4-adf1-21d39fe52b1f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:10.605617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1145/2306] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:10.609627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880eb23-8a0c-4a98-9d8a-7d386dd60b14 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:10.620837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880eb23-8a0c-4a98-9d8a-7d386dd60b14 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:10.625941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6425b871-1c11-4e6b-91c5-5a404b315392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:10.626605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b871-1c11-4e6b-91c5-5a404b315392 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.626919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b871-1c11-4e6b-91c5-5a404b315392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.627195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6425b871-1c11-4e6b-91c5-5a404b315392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.628056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425b871-1c11-4e6b-91c5-5a404b315392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:10.629673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6425b871-1c11-4e6b-91c5-5a404b315392 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:10.639763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1162/2307] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:10.643968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c626c-c121-4bb4-adf1-21d39fe52b1f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:10.654707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518c626c-c121-4bb4-adf1-21d39fe52b1f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:10.660302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:10.661196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.661480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.661768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] PATH_INFO: `/v3/projects/f83653915d8a4b218e53ce4cb4ed3378/users/158ac59f3c3849dbbf3b5edc8e982cb1/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.678075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f83653915d8a4b218e53ce4cb4ed3378, user_id=158ac59f3c3849dbbf3b5edc8e982cb1, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:10.680803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:10.695689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1146/2308] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:10 2022] PUT /identity/v3/projects/f83653915d8a4b218e53ce4cb4ed3378/users/158ac59f3c3849dbbf3b5edc8e982cb1/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:10.707964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17579d-0576-422c-a23e-6153cabc35f4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.708407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17579d-0576-422c-a23e-6153cabc35f4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.708721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17579d-0576-422c-a23e-6153cabc35f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.739638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8f17579d-0576-422c-a23e-6153cabc35f4 None None] MFA Rules not processed for user `158ac59f3c3849dbbf3b5edc8e982cb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:10.740918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8f17579d-0576-422c-a23e-6153cabc35f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:10.807542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1163/2309] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:10.818243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:10.820273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:10.894947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a207d520-55f9-4e1e-ac7e-a3c0ada9dffd admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:10.901011 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac85bc-8eb8-47ce-a10d-b929666a9e51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:10.901637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac85bc-8eb8-47ce-a10d-b929666a9e51 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:10.901942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac85bc-8eb8-47ce-a10d-b929666a9e51 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:10.902220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac85bc-8eb8-47ce-a10d-b929666a9e51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:10.910320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac85bc-8eb8-47ce-a10d-b929666a9e51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:10.911936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfac85bc-8eb8-47ce-a10d-b929666a9e51 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:10.920841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1147/2310] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:13.653570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17579d-0576-422c-a23e-6153cabc35f4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:13.723671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17579d-0576-422c-a23e-6153cabc35f4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:13.732136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:13.733455 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:13.733798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:13.734079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] PATH_INFO: `/v3/users/158ac59f3c3849dbbf3b5edc8e982cb1` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:13.735438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=158ac59f3c3849dbbf3b5edc8e982cb1)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:13.737427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:13.790080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '158ac59f3c3849dbbf3b5edc8e982cb1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:13.790737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '158ac59f3c3849dbbf3b5edc8e982cb1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:13.798109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '158ac59f3c3849dbbf3b5edc8e982cb1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:13.800363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:13.806326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '158ac59f3c3849dbbf3b5edc8e982cb1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:13.807229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '158ac59f3c3849dbbf3b5edc8e982cb1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:13.826632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1164/2311] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:13 2022] DELETE /identity/v3/users/158ac59f3c3849dbbf3b5edc8e982cb1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:13.831329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883cf6a-e883-4154-ad63-222d8458336f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:13.831860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883cf6a-e883-4154-ad63-222d8458336f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:13.832080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883cf6a-e883-4154-ad63-222d8458336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:13.850494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-9883cf6a-e883-4154-ad63-222d8458336f None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:13.851778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9883cf6a-e883-4154-ad63-222d8458336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:13.913956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1148/2312] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:48:13.924210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:13.925747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:13.987265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d72de-7bf4-4221-a935-a125f92d86f8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:13.993622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de65f76-d94a-415b-8c7b-7e91de141d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:13.994598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65f76-d94a-415b-8c7b-7e91de141d65 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:13.995053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65f76-d94a-415b-8c7b-7e91de141d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:13.995446 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65f76-d94a-415b-8c7b-7e91de141d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.006896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de65f76-d94a-415b-8c7b-7e91de141d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:14.008380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de65f76-d94a-415b-8c7b-7e91de141d65 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:14.018264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1165/2313] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:14.303058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883cf6a-e883-4154-ad63-222d8458336f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:14.304673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9883cf6a-e883-4154-ad63-222d8458336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:14.319984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883cf6a-e883-4154-ad63-222d8458336f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:14.325600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:14.326599 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.326822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.327106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] PATH_INFO: `/v3/projects/f83653915d8a4b218e53ce4cb4ed3378` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.328375 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f83653915d8a4b218e53ce4cb4ed3378)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:14.330408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:14.374829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:14.382183 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f83653915d8a4b218e53ce4cb4ed3378', 'request_id': 'req-51c37487-a119-4b44-8c54-054c644a3e79'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:14.391880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f83653915d8a4b218e53ce4cb4ed3378', 'request_id': 'req-51c37487-a119-4b44-8c54-054c644a3e79'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:14.398218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f83653915d8a4b218e53ce4cb4ed3378', 'request_id': 'req-51c37487-a119-4b44-8c54-054c644a3e79'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:14.410699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] The token cache is being invalidate because project f83653915d8a4b218e53ce4cb4ed3378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:14.410989 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:14.411694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-51c37487-a119-4b44-8c54-054c644a3e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:14.413361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1149/2314] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:14 2022] DELETE /identity/v3/projects/f83653915d8a4b218e53ce4cb4ed3378 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:14.420612 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5983a7-9e18-455e-b16b-2480be4ccd82 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.420840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5983a7-9e18-455e-b16b-2480be4ccd82 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.421123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5983a7-9e18-455e-b16b-2480be4ccd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.439234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ba5983a7-9e18-455e-b16b-2480be4ccd82 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:14.440494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ba5983a7-9e18-455e-b16b-2480be4ccd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:14.503945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1166/2315] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:14.512272 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b436a3-8bf6-4cb4-8cae-146aa4991921 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.512563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b436a3-8bf6-4cb4-8cae-146aa4991921 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.512842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b436a3-8bf6-4cb4-8cae-146aa4991921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.532932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-13b436a3-8bf6-4cb4-8cae-146aa4991921 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:14.534151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-13b436a3-8bf6-4cb4-8cae-146aa4991921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:14.542672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1150/2316] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:14.547576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5983a7-9e18-455e-b16b-2480be4ccd82 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:14.562945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5983a7-9e18-455e-b16b-2480be4ccd82 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:14.567886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:14.568553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.568828 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.569102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.569842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:48:14.570156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:14.572104 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:14.584166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1167/2317] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:48:14.588660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b436a3-8bf6-4cb4-8cae-146aa4991921 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:14.598167 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b436a3-8bf6-4cb4-8cae-146aa4991921 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:14.603854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ab866-70be-45d9-9ab3-d9330a920078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:14.604508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ab866-70be-45d9-9ab3-d9330a920078 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.604792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ab866-70be-45d9-9ab3-d9330a920078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.605089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ab866-70be-45d9-9ab3-d9330a920078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.605753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ab866-70be-45d9-9ab3-d9330a920078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:14.607702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ab866-70be-45d9-9ab3-d9330a920078 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:14.635746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1151/2318] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:14 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:48:14.641603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:14.655326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1a4d0-796e-4cf3-bc50-061191962541 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:14.713504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052a149-ae2b-49a8-942d-3e0fd5525571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:14.714105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a149-ae2b-49a8-942d-3e0fd5525571 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.714387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a149-ae2b-49a8-942d-3e0fd5525571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.714658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052a149-ae2b-49a8-942d-3e0fd5525571 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.715771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052a149-ae2b-49a8-942d-3e0fd5525571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:14.717717 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052a149-ae2b-49a8-942d-3e0fd5525571 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:14.727183 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:14.741410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1168/2319] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:14 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:14.745725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ab866-70be-45d9-9ab3-d9330a920078 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:14.756521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ab866-70be-45d9-9ab3-d9330a920078 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:14.762456 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90899ae-b31d-47a9-91e4-d89ad44ca0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:14.763158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90899ae-b31d-47a9-91e4-d89ad44ca0dc admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.763439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90899ae-b31d-47a9-91e4-d89ad44ca0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.763787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90899ae-b31d-47a9-91e4-d89ad44ca0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.764538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90899ae-b31d-47a9-91e4-d89ad44ca0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:14.766115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90899ae-b31d-47a9-91e4-d89ad44ca0dc admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:14.777526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1152/2320] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:14.782416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052a149-ae2b-49a8-942d-3e0fd5525571 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:14.798601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052a149-ae2b-49a8-942d-3e0fd5525571 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:14.807687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9971c1-a204-4c8b-ad60-e6780ed2d59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:14.808712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9971c1-a204-4c8b-ad60-e6780ed2d59d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.809079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9971c1-a204-4c8b-ad60-e6780ed2d59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.809413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9971c1-a204-4c8b-ad60-e6780ed2d59d admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.810619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9971c1-a204-4c8b-ad60-e6780ed2d59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:14.812749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9971c1-a204-4c8b-ad60-e6780ed2d59d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:14.824397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1169/2321] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:48:14.830038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90899ae-b31d-47a9-91e4-d89ad44ca0dc admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:14.843983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90899ae-b31d-47a9-91e4-d89ad44ca0dc admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:14.849174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:14.850068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.850370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.850639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] PATH_INFO: `/v3/projects/013bd2c3101844deaa601c417057b867/users/2a652a7a68da41b183f01041ebfc963d/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.866815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013bd2c3101844deaa601c417057b867, user_id=2a652a7a68da41b183f01041ebfc963d, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:14.869531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:14.887547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1153/2322] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:14 2022] PUT /identity/v3/projects/013bd2c3101844deaa601c417057b867/users/2a652a7a68da41b183f01041ebfc963d/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:14.898235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159f3e-59c7-4c0c-9dfd-a4235f06ac01 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:14.898518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159f3e-59c7-4c0c-9dfd-a4235f06ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:14.898806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159f3e-59c7-4c0c-9dfd-a4235f06ac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:14.926868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cc159f3e-59c7-4c0c-9dfd-a4235f06ac01 None None] MFA Rules not processed for user `2a652a7a68da41b183f01041ebfc963d`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:14.928456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cc159f3e-59c7-4c0c-9dfd-a4235f06ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:15.000671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1170/2323] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:15.012279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:15.014203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:15.073800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3035f7-351c-4c4e-b1be-766313210319 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:15.077614 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8faa7-cd7d-4d2a-a639-0e40d56b14ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:15.078281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8faa7-cd7d-4d2a-a639-0e40d56b14ae service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:15.078593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8faa7-cd7d-4d2a-a639-0e40d56b14ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:15.078870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8faa7-cd7d-4d2a-a639-0e40d56b14ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:15.087343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8faa7-cd7d-4d2a-a639-0e40d56b14ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:15.088906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a8faa7-cd7d-4d2a-a639-0e40d56b14ae service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:15.097697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1154/2324] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:23.533190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc159f3e-59c7-4c0c-9dfd-a4235f06ac01 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:23.603511 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc159f3e-59c7-4c0c-9dfd-a4235f06ac01 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:23.608837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:23.609724 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:23.610000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:23.610269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] PATH_INFO: `/v3/users/2a652a7a68da41b183f01041ebfc963d` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:23.611499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a652a7a68da41b183f01041ebfc963d)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:23.613524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:23.663583 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a652a7a68da41b183f01041ebfc963d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:23.664315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a652a7a68da41b183f01041ebfc963d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:23.673867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a652a7a68da41b183f01041ebfc963d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:23.681725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a652a7a68da41b183f01041ebfc963d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:23.682390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a652a7a68da41b183f01041ebfc963d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:23.690252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:23.702028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1171/2325] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:23 2022] DELETE /identity/v3/users/2a652a7a68da41b183f01041ebfc963d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:23.706635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffe617-a5ea-46cd-98bc-e7ff2cc2bb5a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:23.707104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffe617-a5ea-46cd-98bc-e7ff2cc2bb5a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:23.707218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffe617-a5ea-46cd-98bc-e7ff2cc2bb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:23.725196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-2bffe617-a5ea-46cd-98bc-e7ff2cc2bb5a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:23.726721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2bffe617-a5ea-46cd-98bc-e7ff2cc2bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:23.787932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1155/2326] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:23.797828 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:23.799434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:23.862030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d1d8e7-0385-4299-b8cc-79f0b9210640 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:23.866459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c58944-0cdd-4488-9175-d10471bd8b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:23.867146 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58944-0cdd-4488-9175-d10471bd8b4a service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:23.867458 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58944-0cdd-4488-9175-d10471bd8b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:23.867758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c58944-0cdd-4488-9175-d10471bd8b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:23.877214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c58944-0cdd-4488-9175-d10471bd8b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:23.878651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c58944-0cdd-4488-9175-d10471bd8b4a service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:23.888843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1172/2327] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:24.161787 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffe617-a5ea-46cd-98bc-e7ff2cc2bb5a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.163336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2bffe617-a5ea-46cd-98bc-e7ff2cc2bb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:24.176419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffe617-a5ea-46cd-98bc-e7ff2cc2bb5a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.182082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.182972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.183316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.183589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] PATH_INFO: `/v3/projects/013bd2c3101844deaa601c417057b867` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.185044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] RBAC: Authorizing `identity:delete_project(project_id=013bd2c3101844deaa601c417057b867)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.187152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:24.189773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:24.239533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013bd2c3101844deaa601c417057b867', 'request_id': 'req-379b155c-5732-4130-8f1f-5cd79c92d75c'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:24.248653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013bd2c3101844deaa601c417057b867', 'request_id': 'req-379b155c-5732-4130-8f1f-5cd79c92d75c'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:24.255079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013bd2c3101844deaa601c417057b867', 'request_id': 'req-379b155c-5732-4130-8f1f-5cd79c92d75c'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:24.266579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] The token cache is being invalidate because project 013bd2c3101844deaa601c417057b867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:24.266860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:24.267488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-379b155c-5732-4130-8f1f-5cd79c92d75c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:24.269085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1156/2328] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:24 2022] DELETE /identity/v3/projects/013bd2c3101844deaa601c417057b867 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:24.274099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d59d65-642c-4e9a-8344-d60d994aece9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.274380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d59d65-642c-4e9a-8344-d60d994aece9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.274655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d59d65-642c-4e9a-8344-d60d994aece9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.292439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-29d59d65-642c-4e9a-8344-d60d994aece9 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:24.293567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-29d59d65-642c-4e9a-8344-d60d994aece9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:24.353238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1173/2329] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:24.361395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf61f7-bd3c-4234-926a-9f24dda34658 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.361680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf61f7-bd3c-4234-926a-9f24dda34658 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.361957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf61f7-bd3c-4234-926a-9f24dda34658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.380591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-acaf61f7-bd3c-4234-926a-9f24dda34658 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:24.381789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-acaf61f7-bd3c-4234-926a-9f24dda34658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:24.390333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1157/2330] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:24.394554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d59d65-642c-4e9a-8344-d60d994aece9 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.404219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d59d65-642c-4e9a-8344-d60d994aece9 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.409473 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.410392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.410785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.411197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.412051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:48:24.412357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.413941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:24.425644 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1174/2331] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:48:24.430179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf61f7-bd3c-4234-926a-9f24dda34658 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.440928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf61f7-bd3c-4234-926a-9f24dda34658 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.447022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713b754-dd9b-41dc-aa86-66e50d522eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.447719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713b754-dd9b-41dc-aa86-66e50d522eff admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.447997 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713b754-dd9b-41dc-aa86-66e50d522eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.448262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713b754-dd9b-41dc-aa86-66e50d522eff admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.448959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713b754-dd9b-41dc-aa86-66e50d522eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.450862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713b754-dd9b-41dc-aa86-66e50d522eff admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:24.481422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1158/2332] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:24 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:24.485815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.495695 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c22b0-5cb3-4ff9-8764-494d30dbc2c2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.549910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53255d5-cc57-4e38-bcd2-da0c0e611c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.550526 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53255d5-cc57-4e38-bcd2-da0c0e611c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.550764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53255d5-cc57-4e38-bcd2-da0c0e611c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.551032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53255d5-cc57-4e38-bcd2-da0c0e611c9a admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.551745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53255d5-cc57-4e38-bcd2-da0c0e611c9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.553650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53255d5-cc57-4e38-bcd2-da0c0e611c9a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:24.575069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1175/2333] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:24 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:48:24.579222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713b754-dd9b-41dc-aa86-66e50d522eff admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.589609 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713b754-dd9b-41dc-aa86-66e50d522eff admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.594406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fd989-f81c-4a2e-8378-cda428315b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.595098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fd989-f81c-4a2e-8378-cda428315b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.595374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fd989-f81c-4a2e-8378-cda428315b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.595705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fd989-f81c-4a2e-8378-cda428315b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.596563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fd989-f81c-4a2e-8378-cda428315b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.598159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fd989-f81c-4a2e-8378-cda428315b2e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:24.608752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1159/2334] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:24.612950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53255d5-cc57-4e38-bcd2-da0c0e611c9a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.623863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53255d5-cc57-4e38-bcd2-da0c0e611c9a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.629837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac00dd22-a190-41e8-964d-36f6bc9ffcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.630552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00dd22-a190-41e8-964d-36f6bc9ffcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.630799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00dd22-a190-41e8-964d-36f6bc9ffcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.631075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac00dd22-a190-41e8-964d-36f6bc9ffcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.631894 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00dd22-a190-41e8-964d-36f6bc9ffcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.633536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac00dd22-a190-41e8-964d-36f6bc9ffcb3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:24.639024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:24.645948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1176/2335] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:24.650253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fd989-f81c-4a2e-8378-cda428315b2e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.660906 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fd989-f81c-4a2e-8378-cda428315b2e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.666007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2395-be1a-4ee9-895d-bc6ec7ae8f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.666905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2395-be1a-4ee9-895d-bc6ec7ae8f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.667185 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2395-be1a-4ee9-895d-bc6ec7ae8f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.667461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba2395-be1a-4ee9-895d-bc6ec7ae8f3b admin admin] PATH_INFO: `/v3/projects/49173f77c79846f08a8d9b53a4defc6b/users/4edd887c6cdf4e1a97c9a33be5121df2/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.682572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba2395-be1a-4ee9-895d-bc6ec7ae8f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=49173f77c79846f08a8d9b53a4defc6b, user_id=4edd887c6cdf4e1a97c9a33be5121df2, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.685291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba2395-be1a-4ee9-895d-bc6ec7ae8f3b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:24.700844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1160/2336] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:24 2022] PUT /identity/v3/projects/49173f77c79846f08a8d9b53a4defc6b/users/4edd887c6cdf4e1a97c9a33be5121df2/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:48:24.711471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87ea3-d6e7-4993-831e-eec82b549649 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.711781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87ea3-d6e7-4993-831e-eec82b549649 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.712057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa87ea3-d6e7-4993-831e-eec82b549649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.739824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-cfa87ea3-d6e7-4993-831e-eec82b549649 None None] MFA Rules not processed for user `4edd887c6cdf4e1a97c9a33be5121df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:24.741065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cfa87ea3-d6e7-4993-831e-eec82b549649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:24.804822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1177/2337] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:24.809345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2395-be1a-4ee9-895d-bc6ec7ae8f3b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.872530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba2395-be1a-4ee9-895d-bc6ec7ae8f3b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.877724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646d44-8d38-49ac-b4e2-4b64ab4f3ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.878382 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646d44-8d38-49ac-b4e2-4b64ab4f3ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.878663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646d44-8d38-49ac-b4e2-4b64ab4f3ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.878935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0646d44-8d38-49ac-b4e2-4b64ab4f3ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.879635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0646d44-8d38-49ac-b4e2-4b64ab4f3ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.881546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0646d44-8d38-49ac-b4e2-4b64ab4f3ffa admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:24.909402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1161/2338] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:24 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:24.913550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87ea3-d6e7-4993-831e-eec82b549649 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:24.924903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa87ea3-d6e7-4993-831e-eec82b549649 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:24.983045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a125-6938-4292-8252-84a0449d3ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:24.983732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a125-6938-4292-8252-84a0449d3ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:24.984011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a125-6938-4292-8252-84a0449d3ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:24.984275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa2a125-6938-4292-8252-84a0449d3ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:24.984967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2a125-6938-4292-8252-84a0449d3ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:24.986914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa2a125-6938-4292-8252-84a0449d3ab3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:25.007244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1178/2339] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:24 2022] POST /identity/v3/users => generated 301 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:25.011436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646d44-8d38-49ac-b4e2-4b64ab4f3ffa admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:25.021819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0646d44-8d38-49ac-b4e2-4b64ab4f3ffa admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:25.027003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1c508-ff4a-4020-a676-528bf5b7a563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:25.027727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1c508-ff4a-4020-a676-528bf5b7a563 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.028014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1c508-ff4a-4020-a676-528bf5b7a563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.028299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1c508-ff4a-4020-a676-528bf5b7a563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.029020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1c508-ff4a-4020-a676-528bf5b7a563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:25.030623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1c508-ff4a-4020-a676-528bf5b7a563 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:25.041478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1162/2340] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:25.045860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a125-6938-4292-8252-84a0449d3ab3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:25.056106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa2a125-6938-4292-8252-84a0449d3ab3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:25.060972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4c248-311d-4dc3-8402-0daf15cc0849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:25.061868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c248-311d-4dc3-8402-0daf15cc0849 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.062150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c248-311d-4dc3-8402-0daf15cc0849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.062420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4c248-311d-4dc3-8402-0daf15cc0849 admin admin] PATH_INFO: `/v3/projects/8de1ae0ce0424b71bb2f80e0794e2faf/users/0781c4e04c5548d08a2adabb570faa33/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.080147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4c248-311d-4dc3-8402-0daf15cc0849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de1ae0ce0424b71bb2f80e0794e2faf, user_id=0781c4e04c5548d08a2adabb570faa33, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:25.085502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4c248-311d-4dc3-8402-0daf15cc0849 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:25.104744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1179/2341] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:25 2022] PUT /identity/v3/projects/8de1ae0ce0424b71bb2f80e0794e2faf/users/0781c4e04c5548d08a2adabb570faa33/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:48:25.110354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1c508-ff4a-4020-a676-528bf5b7a563 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:25.115799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:25.121932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1c508-ff4a-4020-a676-528bf5b7a563 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:25.181287 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11336d9d-6a9e-4c8c-96d5-81e0c6aa7468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:25.181965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336d9d-6a9e-4c8c-96d5-81e0c6aa7468 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.182250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336d9d-6a9e-4c8c-96d5-81e0c6aa7468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.182529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11336d9d-6a9e-4c8c-96d5-81e0c6aa7468 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.183263 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336d9d-6a9e-4c8c-96d5-81e0c6aa7468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:25.185071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11336d9d-6a9e-4c8c-96d5-81e0c6aa7468 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:25.195827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1163/2342] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:25.200669 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4c248-311d-4dc3-8402-0daf15cc0849 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:25.211937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4c248-311d-4dc3-8402-0daf15cc0849 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:25.217856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:25.218762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.219052 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.219329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] PATH_INFO: `/v3/projects/8de1ae0ce0424b71bb2f80e0794e2faf/users/0781c4e04c5548d08a2adabb570faa33/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.221752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de1ae0ce0424b71bb2f80e0794e2faf, user_id=0781c4e04c5548d08a2adabb570faa33, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:25.225114 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:25.236398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1180/2343] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:25 2022] PUT /identity/v3/projects/8de1ae0ce0424b71bb2f80e0794e2faf/users/0781c4e04c5548d08a2adabb570faa33/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:25.247918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360a2c-e738-4cd1-bf06-dd678ce3e723 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.248206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360a2c-e738-4cd1-bf06-dd678ce3e723 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.248482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34360a2c-e738-4cd1-bf06-dd678ce3e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.275468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-34360a2c-e738-4cd1-bf06-dd678ce3e723 None None] MFA Rules not processed for user `0781c4e04c5548d08a2adabb570faa33`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:25.276707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-34360a2c-e738-4cd1-bf06-dd678ce3e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:25.347244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1164/2344] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:25.358223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:25.360346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:25.406951 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:25.419630 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb8bed-3e87-464a-be7e-c65e9ad14262 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:25.423498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc6f4f-07bc-4913-ba5d-8b7b521c549d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:25.424318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc6f4f-07bc-4913-ba5d-8b7b521c549d service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.424780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc6f4f-07bc-4913-ba5d-8b7b521c549d service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.425196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc6f4f-07bc-4913-ba5d-8b7b521c549d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.436120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc6f4f-07bc-4913-ba5d-8b7b521c549d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:25.437627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc6f4f-07bc-4913-ba5d-8b7b521c549d service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:25.448200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1181/2345] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:25.573417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34360a2c-e738-4cd1-bf06-dd678ce3e723 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:25.638502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34360a2c-e738-4cd1-bf06-dd678ce3e723 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:25.644562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:25.645446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.645715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.645992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] PATH_INFO: `/v3/users/4edd887c6cdf4e1a97c9a33be5121df2` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.647307 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edd887c6cdf4e1a97c9a33be5121df2)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:25.649482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:25.685983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:25.705914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edd887c6cdf4e1a97c9a33be5121df2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:25.714366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edd887c6cdf4e1a97c9a33be5121df2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:25.715258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edd887c6cdf4e1a97c9a33be5121df2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:25.724845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edd887c6cdf4e1a97c9a33be5121df2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:25.738016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edd887c6cdf4e1a97c9a33be5121df2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:25.744235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1165/2346] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:25 2022] DELETE /identity/v3/users/4edd887c6cdf4e1a97c9a33be5121df2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:25.748868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dabdf-3819-4503-b6f2-caa3ad7bfd80 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.749352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dabdf-3819-4503-b6f2-caa3ad7bfd80 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.749465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4dabdf-3819-4503-b6f2-caa3ad7bfd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.767814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ea4dabdf-3819-4503-b6f2-caa3ad7bfd80 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:25.769046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ea4dabdf-3819-4503-b6f2-caa3ad7bfd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:25.835261 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1182/2347] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:25.845934 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:25.847631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:25.914062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c3471-23d0-4c18-96ff-1737d09ea1e0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:25.918212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d473e05-3618-4aa0-ab10-8fa6f72726fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:25.918860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d473e05-3618-4aa0-ab10-8fa6f72726fb service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:25.919154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d473e05-3618-4aa0-ab10-8fa6f72726fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:25.919431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d473e05-3618-4aa0-ab10-8fa6f72726fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:25.929265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d473e05-3618-4aa0-ab10-8fa6f72726fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:25.930702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d473e05-3618-4aa0-ab10-8fa6f72726fb service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:25.940467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1166/2348] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:26.219213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dabdf-3819-4503-b6f2-caa3ad7bfd80 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:26.220715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ea4dabdf-3819-4503-b6f2-caa3ad7bfd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:26.233347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4dabdf-3819-4503-b6f2-caa3ad7bfd80 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:26.238519 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:26.239463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:26.239779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:26.240056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] PATH_INFO: `/v3/projects/49173f77c79846f08a8d9b53a4defc6b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:26.241426 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49173f77c79846f08a8d9b53a4defc6b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:26.243346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:26.290977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49173f77c79846f08a8d9b53a4defc6b', 'request_id': 'req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.297456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49173f77c79846f08a8d9b53a4defc6b', 'request_id': 'req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.306147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49173f77c79846f08a8d9b53a4defc6b', 'request_id': 'req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.316655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] The token cache is being invalidate because project 49173f77c79846f08a8d9b53a4defc6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:26.316943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.317596 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.319148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1183/2349] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:26 2022] DELETE /identity/v3/projects/49173f77c79846f08a8d9b53a4defc6b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:26.323779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d473e05-3618-4aa0-ab10-8fa6f72726fb service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:26.334030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d473e05-3618-4aa0-ab10-8fa6f72726fb service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:26.392655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:26.393640 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:26.393914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:26.394186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] PATH_INFO: `/v3/users/0781c4e04c5548d08a2adabb570faa33` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:26.395430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0781c4e04c5548d08a2adabb570faa33)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:26.397429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:26.456998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0781c4e04c5548d08a2adabb570faa33'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.458690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:26.466465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0781c4e04c5548d08a2adabb570faa33'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.467155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0781c4e04c5548d08a2adabb570faa33'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.475206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0781c4e04c5548d08a2adabb570faa33'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.487260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-63641bcf-a425-4ab8-be8d-61c89f358610 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0781c4e04c5548d08a2adabb570faa33'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.493296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1167/2350] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:26 2022] DELETE /identity/v3/users/0781c4e04c5548d08a2adabb570faa33 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:26.777182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:26.778841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:26.793269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d21c8-c397-4f4c-b6b5-51a59edf5f63 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:26.853203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:26.854081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:26.854362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:26.854618 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] PATH_INFO: `/v3/projects/8de1ae0ce0424b71bb2f80e0794e2faf` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:26.855855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de1ae0ce0424b71bb2f80e0794e2faf)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:26.857781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:26.868277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:26.904762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de1ae0ce0424b71bb2f80e0794e2faf', 'request_id': 'req-6e83fa15-484d-43d3-890d-f720dc125842'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.910712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de1ae0ce0424b71bb2f80e0794e2faf', 'request_id': 'req-6e83fa15-484d-43d3-890d-f720dc125842'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.919970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de1ae0ce0424b71bb2f80e0794e2faf', 'request_id': 'req-6e83fa15-484d-43d3-890d-f720dc125842'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.930978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] The token cache is being invalidate because project 8de1ae0ce0424b71bb2f80e0794e2faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:26.931369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.932187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6e83fa15-484d-43d3-890d-f720dc125842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:26.933800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1184/2351] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:26 2022] DELETE /identity/v3/projects/8de1ae0ce0424b71bb2f80e0794e2faf => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:48:26.938946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d94d-be8a-4dde-b96f-e2eac4198a70 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:26.939428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d94d-be8a-4dde-b96f-e2eac4198a70 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:26.939523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b0d94d-be8a-4dde-b96f-e2eac4198a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:26.958627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-a4b0d94d-be8a-4dde-b96f-e2eac4198a70 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:26.960018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a4b0d94d-be8a-4dde-b96f-e2eac4198a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:27.020411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1168/2352] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:27.031363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea58f-c0d2-47ec-81d2-c38ca5148d48 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.031682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea58f-c0d2-47ec-81d2-c38ca5148d48 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.031954 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ea58f-c0d2-47ec-81d2-c38ca5148d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.051487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-969ea58f-c0d2-47ec-81d2-c38ca5148d48 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:27.052732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-969ea58f-c0d2-47ec-81d2-c38ca5148d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:27.061848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1185/2353] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:27.066188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0d94d-be8a-4dde-b96f-e2eac4198a70 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.076953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b0d94d-be8a-4dde-b96f-e2eac4198a70 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.082616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.083303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.083585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.083890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.084625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:48:27.084936 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.086584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.100074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1169/2354] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:48:27.104956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ea58f-c0d2-47ec-81d2-c38ca5148d48 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.116457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ea58f-c0d2-47ec-81d2-c38ca5148d48 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.122551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd91f15-8a54-4827-b25d-e9ed78832bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.123225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd91f15-8a54-4827-b25d-e9ed78832bac admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.124206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd91f15-8a54-4827-b25d-e9ed78832bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.124485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd91f15-8a54-4827-b25d-e9ed78832bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.125195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd91f15-8a54-4827-b25d-e9ed78832bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.127139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd91f15-8a54-4827-b25d-e9ed78832bac admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.160288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1186/2355] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:27 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:27.164429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.174960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e8bd46-79ce-450c-8256-515414be3c3d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.234022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4d0f-b131-4d47-aa94-83ce53a25ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.234687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4d0f-b131-4d47-aa94-83ce53a25ebe admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.234967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4d0f-b131-4d47-aa94-83ce53a25ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.235240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99a4d0f-b131-4d47-aa94-83ce53a25ebe admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.235958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a4d0f-b131-4d47-aa94-83ce53a25ebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.237838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99a4d0f-b131-4d47-aa94-83ce53a25ebe admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.259223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1170/2356] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:27 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:27.263353 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd91f15-8a54-4827-b25d-e9ed78832bac admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.273888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd91f15-8a54-4827-b25d-e9ed78832bac admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.278639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757b3a-f30a-42ef-97e4-1977877c9382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.279302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757b3a-f30a-42ef-97e4-1977877c9382 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.279577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757b3a-f30a-42ef-97e4-1977877c9382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.279883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71757b3a-f30a-42ef-97e4-1977877c9382 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.280599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757b3a-f30a-42ef-97e4-1977877c9382 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.282178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71757b3a-f30a-42ef-97e4-1977877c9382 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.292794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1187/2357] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:27.296559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4d0f-b131-4d47-aa94-83ce53a25ebe admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.306436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99a4d0f-b131-4d47-aa94-83ce53a25ebe admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.311666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8702c-5037-4593-981c-aad31b387c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.312360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8702c-5037-4593-981c-aad31b387c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.312612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8702c-5037-4593-981c-aad31b387c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.313002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8702c-5037-4593-981c-aad31b387c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.313761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8702c-5037-4593-981c-aad31b387c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.315400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8702c-5037-4593-981c-aad31b387c23 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.326350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1171/2358] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:27.330862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757b3a-f30a-42ef-97e4-1977877c9382 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.341525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71757b3a-f30a-42ef-97e4-1977877c9382 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.346532 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111cd0c-f498-43a0-bf0c-73562a698b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.347418 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cd0c-f498-43a0-bf0c-73562a698b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.347731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cd0c-f498-43a0-bf0c-73562a698b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.348007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111cd0c-f498-43a0-bf0c-73562a698b2f admin admin] PATH_INFO: `/v3/projects/236b01bd407f44918710cbf0cc326047/users/74cd22a85b0d4a8cb9246e4c4efb2bcc/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.363423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111cd0c-f498-43a0-bf0c-73562a698b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=236b01bd407f44918710cbf0cc326047, user_id=74cd22a85b0d4a8cb9246e4c4efb2bcc, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.366134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111cd0c-f498-43a0-bf0c-73562a698b2f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.380706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1188/2359] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:27 2022] PUT /identity/v3/projects/236b01bd407f44918710cbf0cc326047/users/74cd22a85b0d4a8cb9246e4c4efb2bcc/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:27.391118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91a87-4a73-4eb2-9d64-51784c2bb2ba None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.391401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91a87-4a73-4eb2-9d64-51784c2bb2ba None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.391717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91a87-4a73-4eb2-9d64-51784c2bb2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.419165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d1e91a87-4a73-4eb2-9d64-51784c2bb2ba None None] MFA Rules not processed for user `74cd22a85b0d4a8cb9246e4c4efb2bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:27.420531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d1e91a87-4a73-4eb2-9d64-51784c2bb2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:27.439514 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:27.490667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1172/2360] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:48:27.495262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111cd0c-f498-43a0-bf0c-73562a698b2f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.557528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111cd0c-f498-43a0-bf0c-73562a698b2f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.562398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0cfd0-7e08-4936-95bf-4f68fafae06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.563071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0cfd0-7e08-4936-95bf-4f68fafae06a admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.563356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0cfd0-7e08-4936-95bf-4f68fafae06a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.563660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0cfd0-7e08-4936-95bf-4f68fafae06a admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.564370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0cfd0-7e08-4936-95bf-4f68fafae06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.566429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0cfd0-7e08-4936-95bf-4f68fafae06a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.592745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1189/2361] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:27 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:48:27.596951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91a87-4a73-4eb2-9d64-51784c2bb2ba None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.607929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91a87-4a73-4eb2-9d64-51784c2bb2ba None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.671538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd8006-8f3f-4249-b658-1c6c61fe7641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.672271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8006-8f3f-4249-b658-1c6c61fe7641 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.672555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8006-8f3f-4249-b658-1c6c61fe7641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.672835 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd8006-8f3f-4249-b658-1c6c61fe7641 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.673537 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd8006-8f3f-4249-b658-1c6c61fe7641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.675946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd8006-8f3f-4249-b658-1c6c61fe7641 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.697982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1173/2362] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:27 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:27.702136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0cfd0-7e08-4936-95bf-4f68fafae06a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.712739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0cfd0-7e08-4936-95bf-4f68fafae06a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.717764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a4d9-6e05-4c18-9578-1315f7741a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.718435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a4d9-6e05-4c18-9578-1315f7741a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.718715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a4d9-6e05-4c18-9578-1315f7741a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.718991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4a4d9-6e05-4c18-9578-1315f7741a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.719756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4a4d9-6e05-4c18-9578-1315f7741a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.722483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4a4d9-6e05-4c18-9578-1315f7741a79 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.735971 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1190/2363] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:27.740498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd8006-8f3f-4249-b658-1c6c61fe7641 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.750949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd8006-8f3f-4249-b658-1c6c61fe7641 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.755983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3217a-fc36-47eb-8816-8d3030d3de2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.756905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3217a-fc36-47eb-8816-8d3030d3de2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.757193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3217a-fc36-47eb-8816-8d3030d3de2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.757470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3217a-fc36-47eb-8816-8d3030d3de2a admin admin] PATH_INFO: `/v3/projects/7a28c525fe4f4beb94f8557a76267662/users/95bf578c6f0247c78cc5a2b848417692/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.777799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3217a-fc36-47eb-8816-8d3030d3de2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a28c525fe4f4beb94f8557a76267662, user_id=95bf578c6f0247c78cc5a2b848417692, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.783942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3217a-fc36-47eb-8816-8d3030d3de2a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.800280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1174/2364] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:27 2022] PUT /identity/v3/projects/7a28c525fe4f4beb94f8557a76267662/users/95bf578c6f0247c78cc5a2b848417692/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:27.804523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a4d9-6e05-4c18-9578-1315f7741a79 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.815282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4a4d9-6e05-4c18-9578-1315f7741a79 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.820431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:27.877143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6c95-ee5d-4558-8779-9c86f274f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.877822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6c95-ee5d-4558-8779-9c86f274f080 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.878106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6c95-ee5d-4558-8779-9c86f274f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.878355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6c95-ee5d-4558-8779-9c86f274f080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.879149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b6c95-ee5d-4558-8779-9c86f274f080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.880792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b6c95-ee5d-4558-8779-9c86f274f080 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.891196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1191/2365] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:27.895637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3217a-fc36-47eb-8816-8d3030d3de2a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:27.906442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3217a-fc36-47eb-8816-8d3030d3de2a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:27.912453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:27.913470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.913754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.914024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] PATH_INFO: `/v3/projects/7a28c525fe4f4beb94f8557a76267662/users/95bf578c6f0247c78cc5a2b848417692/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.916330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a28c525fe4f4beb94f8557a76267662, user_id=95bf578c6f0247c78cc5a2b848417692, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:27.918960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:27.930262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1175/2366] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:27 2022] PUT /identity/v3/projects/7a28c525fe4f4beb94f8557a76267662/users/95bf578c6f0247c78cc5a2b848417692/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:27.941900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3230c7-5267-4e8a-a5af-a9955fa4b838 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:27.942218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3230c7-5267-4e8a-a5af-a9955fa4b838 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:27.942523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3230c7-5267-4e8a-a5af-a9955fa4b838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:27.971676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ec3230c7-5267-4e8a-a5af-a9955fa4b838 None None] MFA Rules not processed for user `95bf578c6f0247c78cc5a2b848417692`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:27.973012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ec3230c7-5267-4e8a-a5af-a9955fa4b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:28.046662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1192/2367] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:28.061108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:28.063143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:28.122468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e75a840-d365-424b-b101-a0f0e577470e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:28.126927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61a301-4db0-4d94-92c3-0c282d273418 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:28.127778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61a301-4db0-4d94-92c3-0c282d273418 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:28.128064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61a301-4db0-4d94-92c3-0c282d273418 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:28.128341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61a301-4db0-4d94-92c3-0c282d273418 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:28.155073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:28.188301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61a301-4db0-4d94-92c3-0c282d273418 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:28.189750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61a301-4db0-4d94-92c3-0c282d273418 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:28.199587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1176/2368] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:32.454967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3230c7-5267-4e8a-a5af-a9955fa4b838 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:32.456698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ec3230c7-5267-4e8a-a5af-a9955fa4b838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:32.469058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3230c7-5267-4e8a-a5af-a9955fa4b838 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:32.473173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a035600-7fbb-4779-a6ba-7df40e602acd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:32.473829 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a035600-7fbb-4779-a6ba-7df40e602acd service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:32.474090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a035600-7fbb-4779-a6ba-7df40e602acd service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:32.474341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a035600-7fbb-4779-a6ba-7df40e602acd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:32.484302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a035600-7fbb-4779-a6ba-7df40e602acd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:32.485741 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a035600-7fbb-4779-a6ba-7df40e602acd service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:32.495701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1193/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:37.408292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61a301-4db0-4d94-92c3-0c282d273418 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:37.526018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61a301-4db0-4d94-92c3-0c282d273418 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:37.529931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:37.531088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:37.531373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:37.531680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] PATH_INFO: `/v3/users/74cd22a85b0d4a8cb9246e4c4efb2bcc` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:37.533626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74cd22a85b0d4a8cb9246e4c4efb2bcc)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:37.535987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:37.608424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74cd22a85b0d4a8cb9246e4c4efb2bcc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:37.625904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74cd22a85b0d4a8cb9246e4c4efb2bcc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:37.626199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74cd22a85b0d4a8cb9246e4c4efb2bcc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:37.636240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74cd22a85b0d4a8cb9246e4c4efb2bcc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:37.652204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74cd22a85b0d4a8cb9246e4c4efb2bcc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:37.671948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1177/2370] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:37 2022] DELETE /identity/v3/users/74cd22a85b0d4a8cb9246e4c4efb2bcc => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:37.676953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea49a-01db-47f3-9526-7af72af8d46d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:37.677471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea49a-01db-47f3-9526-7af72af8d46d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:37.677570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ea49a-01db-47f3-9526-7af72af8d46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:37.698076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8b9ea49a-01db-47f3-9526-7af72af8d46d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:37.699300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8b9ea49a-01db-47f3-9526-7af72af8d46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:37.758958 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1194/2371] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:37.768628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:37.770126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:37.825915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:37.831191 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce9ee8-0ad7-4179-8133-1963f3a2e864 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:37.835795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293713-a485-4354-87e3-e3437a53aa13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:37.836549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293713-a485-4354-87e3-e3437a53aa13 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:37.836987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293713-a485-4354-87e3-e3437a53aa13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:37.837649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14293713-a485-4354-87e3-e3437a53aa13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:37.849448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14293713-a485-4354-87e3-e3437a53aa13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:37.850889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14293713-a485-4354-87e3-e3437a53aa13 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:37.863953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1178/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:38.182804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea49a-01db-47f3-9526-7af72af8d46d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:38.184359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8b9ea49a-01db-47f3-9526-7af72af8d46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:38.200815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ea49a-01db-47f3-9526-7af72af8d46d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:38.206890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:38.208588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:38.209067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:38.209628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] PATH_INFO: `/v3/projects/236b01bd407f44918710cbf0cc326047` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:38.211803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=236b01bd407f44918710cbf0cc326047)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:38.214415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:38.234226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:38.289430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '236b01bd407f44918710cbf0cc326047', 'request_id': 'req-288ea0cd-26ed-4141-863f-3224c9e1e110'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.296465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '236b01bd407f44918710cbf0cc326047', 'request_id': 'req-288ea0cd-26ed-4141-863f-3224c9e1e110'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.305404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '236b01bd407f44918710cbf0cc326047', 'request_id': 'req-288ea0cd-26ed-4141-863f-3224c9e1e110'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.319865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] The token cache is being invalidate because project 236b01bd407f44918710cbf0cc326047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:38.320302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.320972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.323263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1195/2373] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:38 2022] DELETE /identity/v3/projects/236b01bd407f44918710cbf0cc326047 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:38.327079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293713-a485-4354-87e3-e3437a53aa13 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:38.344317 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14293713-a485-4354-87e3-e3437a53aa13 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:38.410209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:38.410917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:38.410917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:38.411108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] PATH_INFO: `/v3/users/95bf578c6f0247c78cc5a2b848417692` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:38.412356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95bf578c6f0247c78cc5a2b848417692)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:38.414392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:38.475710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95bf578c6f0247c78cc5a2b848417692'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.488092 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95bf578c6f0247c78cc5a2b848417692'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.488966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95bf578c6f0247c78cc5a2b848417692'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.498730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95bf578c6f0247c78cc5a2b848417692'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.511372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-34e301ca-61da-4f80-ae74-8dffde4792b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95bf578c6f0247c78cc5a2b848417692'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:38.518182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1179/2374] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:38 2022] DELETE /identity/v3/users/95bf578c6f0247c78cc5a2b848417692 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:38.912208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:38.924444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:38.944932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288ea0cd-26ed-4141-863f-3224c9e1e110 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.005822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.006707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.006993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.007269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] PATH_INFO: `/v3/projects/7a28c525fe4f4beb94f8557a76267662` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.008786 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a28c525fe4f4beb94f8557a76267662)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.010711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.062780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a28c525fe4f4beb94f8557a76267662', 'request_id': 'req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:39.069388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a28c525fe4f4beb94f8557a76267662', 'request_id': 'req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:39.077790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a28c525fe4f4beb94f8557a76267662', 'request_id': 'req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:39.090083 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] The token cache is being invalidate because project 7a28c525fe4f4beb94f8557a76267662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:39.090378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:39.091054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1cdd40ba-e41d-4187-b60a-e0ec4109eeae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:39.092908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1196/2375] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:38 2022] DELETE /identity/v3/projects/7a28c525fe4f4beb94f8557a76267662 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:39.098750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e1e6-e3b4-4818-99ae-6af2d95e08ef None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.099069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e1e6-e3b4-4818-99ae-6af2d95e08ef None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.099343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0e1e6-e3b4-4818-99ae-6af2d95e08ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.121876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-bff0e1e6-e3b4-4818-99ae-6af2d95e08ef None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:39.123209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-bff0e1e6-e3b4-4818-99ae-6af2d95e08ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:39.210214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1180/2376] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:39.218268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040cb8-858b-46ac-bf34-c2b5354ef5c8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.219149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040cb8-858b-46ac-bf34-c2b5354ef5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.219149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d040cb8-858b-46ac-bf34-c2b5354ef5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.240442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2d040cb8-858b-46ac-bf34-c2b5354ef5c8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:39.241704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2d040cb8-858b-46ac-bf34-c2b5354ef5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:39.251213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1197/2377] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:48:39.255773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e1e6-e3b4-4818-99ae-6af2d95e08ef None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.267659 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0e1e6-e3b4-4818-99ae-6af2d95e08ef None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.272662 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.273571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.273899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.274266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.275156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:48:39.275454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.277149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.285215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:39.298707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1181/2378] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:48:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:48:39.301944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d040cb8-858b-46ac-bf34-c2b5354ef5c8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.313315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d040cb8-858b-46ac-bf34-c2b5354ef5c8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.318430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff370f1-9ff4-473b-b77e-6cfd50111c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.319137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff370f1-9ff4-473b-b77e-6cfd50111c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.319414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff370f1-9ff4-473b-b77e-6cfd50111c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.319725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff370f1-9ff4-473b-b77e-6cfd50111c38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.320460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff370f1-9ff4-473b-b77e-6cfd50111c38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.322742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff370f1-9ff4-473b-b77e-6cfd50111c38 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.351577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1198/2379] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:39 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:39.355839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.365923 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302acbb0-a8b6-4bc6-8f83-20ae20b16d7f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.421483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b62bc-6ad9-4d28-b36c-c514180519c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.422166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b62bc-6ad9-4d28-b36c-c514180519c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.422448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b62bc-6ad9-4d28-b36c-c514180519c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.422722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b62bc-6ad9-4d28-b36c-c514180519c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.423417 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b62bc-6ad9-4d28-b36c-c514180519c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.425482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b62bc-6ad9-4d28-b36c-c514180519c4 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.449445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1182/2380] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:39 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:39.453588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff370f1-9ff4-473b-b77e-6cfd50111c38 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.459535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:39.467072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff370f1-9ff4-473b-b77e-6cfd50111c38 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.473088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee084677-50ba-4bf3-a7ae-5c95b34fed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.473982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084677-50ba-4bf3-a7ae-5c95b34fed1d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.474260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084677-50ba-4bf3-a7ae-5c95b34fed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.474536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee084677-50ba-4bf3-a7ae-5c95b34fed1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.475306 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee084677-50ba-4bf3-a7ae-5c95b34fed1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.477078 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee084677-50ba-4bf3-a7ae-5c95b34fed1d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.489320 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1199/2381] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:39.493208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b62bc-6ad9-4d28-b36c-c514180519c4 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.504046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b62bc-6ad9-4d28-b36c-c514180519c4 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.508799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6313911-b2b6-4a25-8114-32be7c90f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.509469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313911-b2b6-4a25-8114-32be7c90f8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.509750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313911-b2b6-4a25-8114-32be7c90f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.510025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6313911-b2b6-4a25-8114-32be7c90f8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.510759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6313911-b2b6-4a25-8114-32be7c90f8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.512430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6313911-b2b6-4a25-8114-32be7c90f8b1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.523270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1183/2382] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:39.527816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee084677-50ba-4bf3-a7ae-5c95b34fed1d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.538298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee084677-50ba-4bf3-a7ae-5c95b34fed1d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.543370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ade0f-987b-4939-bfda-0c98c2ada82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.544401 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ade0f-987b-4939-bfda-0c98c2ada82a admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.544722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ade0f-987b-4939-bfda-0c98c2ada82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.545004 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ade0f-987b-4939-bfda-0c98c2ada82a admin admin] PATH_INFO: `/v3/projects/b85c710bf7644734a8f326806155945e/users/b59e8cfe12e543468c12224a557fbf7f/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.559983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ade0f-987b-4939-bfda-0c98c2ada82a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b85c710bf7644734a8f326806155945e, user_id=b59e8cfe12e543468c12224a557fbf7f, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.562607 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ade0f-987b-4939-bfda-0c98c2ada82a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.577292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1200/2383] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:39 2022] PUT /identity/v3/projects/b85c710bf7644734a8f326806155945e/users/b59e8cfe12e543468c12224a557fbf7f/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:39.588788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76bf5-6232-4b53-b654-e78122c35ccd None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.589154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76bf5-6232-4b53-b654-e78122c35ccd None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.589535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc76bf5-6232-4b53-b654-e78122c35ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.616813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ebc76bf5-6232-4b53-b654-e78122c35ccd None None] MFA Rules not processed for user `b59e8cfe12e543468c12224a557fbf7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:39.618046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ebc76bf5-6232-4b53-b654-e78122c35ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:39.694626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1184/2384] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:39.699664 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ade0f-987b-4939-bfda-0c98c2ada82a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.762870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ade0f-987b-4939-bfda-0c98c2ada82a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.767512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853885-3778-41c3-84dd-87d38a7e81ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.768229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853885-3778-41c3-84dd-87d38a7e81ea admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.768513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853885-3778-41c3-84dd-87d38a7e81ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.768853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb853885-3778-41c3-84dd-87d38a7e81ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.769567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853885-3778-41c3-84dd-87d38a7e81ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.771475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb853885-3778-41c3-84dd-87d38a7e81ea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.797528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1201/2385] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:39 2022] POST /identity/v3/projects => generated 377 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:39.802040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76bf5-6232-4b53-b654-e78122c35ccd None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.813146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc76bf5-6232-4b53-b654-e78122c35ccd None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.869450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d5ad4-437a-45c5-a1f5-8588e295f2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.870135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d5ad4-437a-45c5-a1f5-8588e295f2cf admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.870418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d5ad4-437a-45c5-a1f5-8588e295f2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.870687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d5ad4-437a-45c5-a1f5-8588e295f2cf admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.871378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d5ad4-437a-45c5-a1f5-8588e295f2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.873343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d5ad4-437a-45c5-a1f5-8588e295f2cf admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.882278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:39.899573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1185/2386] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:39 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:48:39.900852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853885-3778-41c3-84dd-87d38a7e81ea admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.911923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb853885-3778-41c3-84dd-87d38a7e81ea admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.917334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818fc7-e4d3-47fc-9ba5-1d85479c5906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.918530 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818fc7-e4d3-47fc-9ba5-1d85479c5906 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.918809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818fc7-e4d3-47fc-9ba5-1d85479c5906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.919090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63818fc7-e4d3-47fc-9ba5-1d85479c5906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.919916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63818fc7-e4d3-47fc-9ba5-1d85479c5906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.921542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63818fc7-e4d3-47fc-9ba5-1d85479c5906 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.935550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1202/2387] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:39.939657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d5ad4-437a-45c5-a1f5-8588e295f2cf admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.952998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d5ad4-437a-45c5-a1f5-8588e295f2cf admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.958226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300f24b-a3a6-4bbe-8b1a-7d000f5a79ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.959488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300f24b-a3a6-4bbe-8b1a-7d000f5a79ee admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.959488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300f24b-a3a6-4bbe-8b1a-7d000f5a79ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.959801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300f24b-a3a6-4bbe-8b1a-7d000f5a79ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:39.960629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300f24b-a3a6-4bbe-8b1a-7d000f5a79ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:39.962652 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300f24b-a3a6-4bbe-8b1a-7d000f5a79ee admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:39.978797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1186/2388] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:39.980119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818fc7-e4d3-47fc-9ba5-1d85479c5906 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:39.990298 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63818fc7-e4d3-47fc-9ba5-1d85479c5906 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:39.995005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d50d9-6793-41d8-a3fc-7903d2802477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:39.996031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d50d9-6793-41d8-a3fc-7903d2802477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:39.996379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d50d9-6793-41d8-a3fc-7903d2802477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:39.996813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d50d9-6793-41d8-a3fc-7903d2802477 admin admin] PATH_INFO: `/v3/projects/69810be18348432698ac76c5a1029a5a/users/3d110598766c496b9716b88e23052d20/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.012495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d50d9-6793-41d8-a3fc-7903d2802477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69810be18348432698ac76c5a1029a5a, user_id=3d110598766c496b9716b88e23052d20, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:40.015352 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d50d9-6793-41d8-a3fc-7903d2802477 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:40.030308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1203/2389] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:39 2022] PUT /identity/v3/projects/69810be18348432698ac76c5a1029a5a/users/3d110598766c496b9716b88e23052d20/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:40.042577 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44cde-219f-4f68-a299-407de8e4ebd8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.042958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44cde-219f-4f68-a299-407de8e4ebd8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.043306 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee44cde-219f-4f68-a299-407de8e4ebd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.064622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083ee14-0c54-466e-bd4e-f5d6992a94a1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.065287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083ee14-0c54-466e-bd4e-f5d6992a94a1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.065964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083ee14-0c54-466e-bd4e-f5d6992a94a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.076819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3ee44cde-219f-4f68-a299-407de8e4ebd8 None None] MFA Rules not processed for user `3d110598766c496b9716b88e23052d20`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:40.078146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3ee44cde-219f-4f68-a299-407de8e4ebd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:40.089405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-3083ee14-0c54-466e-bd4e-f5d6992a94a1 None None] MFA Rules not processed for user `636181e787714128869124b40ab14c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:40.090608 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3083ee14-0c54-466e-bd4e-f5d6992a94a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:40.147668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1204/2390] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:40.154978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1187/2391] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:40.159720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083ee14-0c54-466e-bd4e-f5d6992a94a1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:40.184044 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:40.224671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083ee14-0c54-466e-bd4e-f5d6992a94a1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:40.229478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01a987-02b1-4bfe-8fac-53b61be58b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:40.230250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01a987-02b1-4bfe-8fac-53b61be58b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.230535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01a987-02b1-4bfe-8fac-53b61be58b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.230808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01a987-02b1-4bfe-8fac-53b61be58b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.231514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01a987-02b1-4bfe-8fac-53b61be58b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:40.235085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01a987-02b1-4bfe-8fac-53b61be58b07 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:40.263235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1205/2392] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:40 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:48:40.268252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee44cde-219f-4f68-a299-407de8e4ebd8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:40.279396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee44cde-219f-4f68-a299-407de8e4ebd8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:40.338228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0543a-057d-4458-a30c-343f5231a54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:40.338915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0543a-057d-4458-a30c-343f5231a54c admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.339197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0543a-057d-4458-a30c-343f5231a54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.339525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0543a-057d-4458-a30c-343f5231a54c admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.340270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0543a-057d-4458-a30c-343f5231a54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:40.342230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0543a-057d-4458-a30c-343f5231a54c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:40.365278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1188/2393] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:40 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:48:40.366597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01a987-02b1-4bfe-8fac-53b61be58b07 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:40.377267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01a987-02b1-4bfe-8fac-53b61be58b07 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:40.382193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7c5b-109c-4bad-916d-1e0ccf3d5374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:40.382934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7c5b-109c-4bad-916d-1e0ccf3d5374 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.383300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7c5b-109c-4bad-916d-1e0ccf3d5374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.383663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e7c5b-109c-4bad-916d-1e0ccf3d5374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.384470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7c5b-109c-4bad-916d-1e0ccf3d5374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:40.386172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e7c5b-109c-4bad-916d-1e0ccf3d5374 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:40.397807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1206/2394] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:40.402136 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0543a-057d-4458-a30c-343f5231a54c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:40.412510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0543a-057d-4458-a30c-343f5231a54c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:40.417250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14682bf-2120-4e77-85a0-fe8119f6e54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:40.418268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14682bf-2120-4e77-85a0-fe8119f6e54b admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.418555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14682bf-2120-4e77-85a0-fe8119f6e54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.418831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14682bf-2120-4e77-85a0-fe8119f6e54b admin admin] PATH_INFO: `/v3/projects/bf7f0c7140bf452e89365c0d467026d2/users/f10dfee34ed54ccf8b527f691b4556f6/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.434320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14682bf-2120-4e77-85a0-fe8119f6e54b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7f0c7140bf452e89365c0d467026d2, user_id=f10dfee34ed54ccf8b527f691b4556f6, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:40.437024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14682bf-2120-4e77-85a0-fe8119f6e54b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:40.452203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1189/2395] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:40 2022] PUT /identity/v3/projects/bf7f0c7140bf452e89365c0d467026d2/users/f10dfee34ed54ccf8b527f691b4556f6/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:48:40.456316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7c5b-109c-4bad-916d-1e0ccf3d5374 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:40.466528 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e7c5b-109c-4bad-916d-1e0ccf3d5374 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:40.522937 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcc4ba-8d9d-4587-9e0e-e2f21f02c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:40.523632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc4ba-8d9d-4587-9e0e-e2f21f02c0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.523925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc4ba-8d9d-4587-9e0e-e2f21f02c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.524175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcc4ba-8d9d-4587-9e0e-e2f21f02c0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.524923 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcc4ba-8d9d-4587-9e0e-e2f21f02c0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:40.526522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcc4ba-8d9d-4587-9e0e-e2f21f02c0f7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:40.536737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1207/2396] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:40.541526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14682bf-2120-4e77-85a0-fe8119f6e54b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:40.552313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14682bf-2120-4e77-85a0-fe8119f6e54b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:40.558301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:40.559415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.559746 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.560025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] PATH_INFO: `/v3/projects/bf7f0c7140bf452e89365c0d467026d2/users/f10dfee34ed54ccf8b527f691b4556f6/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.562224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf7f0c7140bf452e89365c0d467026d2, user_id=f10dfee34ed54ccf8b527f691b4556f6, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:40.564948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:40.576932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1190/2397] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:40 2022] PUT /identity/v3/projects/bf7f0c7140bf452e89365c0d467026d2/users/f10dfee34ed54ccf8b527f691b4556f6/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:40.587316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6335a4-80cb-46cd-8eec-273cb3da065e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.587620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6335a4-80cb-46cd-8eec-273cb3da065e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.587921 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6335a4-80cb-46cd-8eec-273cb3da065e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.614629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8e6335a4-80cb-46cd-8eec-273cb3da065e None None] MFA Rules not processed for user `f10dfee34ed54ccf8b527f691b4556f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:40.615773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8e6335a4-80cb-46cd-8eec-273cb3da065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:40.688785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1208/2398] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:40.700893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:40.702624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:40.733042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:40.776146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9c40b-ee13-434a-b325-71a84f0c3309 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:40.779959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b010b7-a392-4297-863e-09a3d510472f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:40.780734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010b7-a392-4297-863e-09a3d510472f service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:40.781112 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010b7-a392-4297-863e-09a3d510472f service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:40.781482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b010b7-a392-4297-863e-09a3d510472f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:40.848656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b010b7-a392-4297-863e-09a3d510472f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:40.850039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b010b7-a392-4297-863e-09a3d510472f service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:40.859195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1191/2399] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:42.405244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6335a4-80cb-46cd-8eec-273cb3da065e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:42.406683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8e6335a4-80cb-46cd-8eec-273cb3da065e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:42.418627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6335a4-80cb-46cd-8eec-273cb3da065e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:42.422195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd01d8e-cec5-49d0-a5bd-db2d579bcbee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:42.422847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd01d8e-cec5-49d0-a5bd-db2d579bcbee service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:42.423126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd01d8e-cec5-49d0-a5bd-db2d579bcbee service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:42.423397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd01d8e-cec5-49d0-a5bd-db2d579bcbee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:42.437934 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:42.492732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd01d8e-cec5-49d0-a5bd-db2d579bcbee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:42.503428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd01d8e-cec5-49d0-a5bd-db2d579bcbee service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:42.505592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1209/2400] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:43.110548 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b010b7-a392-4297-863e-09a3d510472f service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:43.119739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b010b7-a392-4297-863e-09a3d510472f service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:43.124810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392f16f-39e6-497b-9c2c-b326b8d8ce86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:43.125540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392f16f-39e6-497b-9c2c-b326b8d8ce86 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:43.125964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392f16f-39e6-497b-9c2c-b326b8d8ce86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:43.126278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392f16f-39e6-497b-9c2c-b326b8d8ce86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:43.137355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392f16f-39e6-497b-9c2c-b326b8d8ce86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:43.138893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392f16f-39e6-497b-9c2c-b326b8d8ce86 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:43.149446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1192/2401] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:47.042407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd01d8e-cec5-49d0-a5bd-db2d579bcbee service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:47.105896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd01d8e-cec5-49d0-a5bd-db2d579bcbee service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:47.110794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:47.111722 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:47.112113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:47.112402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] PATH_INFO: `/v3/users/b59e8cfe12e543468c12224a557fbf7f` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:47.113659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59e8cfe12e543468c12224a557fbf7f)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:47.115626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:47.167462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59e8cfe12e543468c12224a557fbf7f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.168175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59e8cfe12e543468c12224a557fbf7f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.176378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59e8cfe12e543468c12224a557fbf7f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.183292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59e8cfe12e543468c12224a557fbf7f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.183947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59e8cfe12e543468c12224a557fbf7f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.201647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1210/2402] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:47 2022] DELETE /identity/v3/users/b59e8cfe12e543468c12224a557fbf7f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:47.206379 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8829e8-164d-4697-a805-9e869b3899b3 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:47.207026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8829e8-164d-4697-a805-9e869b3899b3 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:47.207026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8829e8-164d-4697-a805-9e869b3899b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:47.223933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0e8829e8-164d-4697-a805-9e869b3899b3 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:47.225146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0e8829e8-164d-4697-a805-9e869b3899b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:47.289475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1193/2403] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:47.299449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:47.301033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:47.343564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:47.362801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa58c9-e010-46c2-b96c-a17d292aaaa3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:47.366865 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb85699-9952-4a84-803f-781446f538ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:47.367506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb85699-9952-4a84-803f-781446f538ef service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:47.367820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb85699-9952-4a84-803f-781446f538ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:47.368119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb85699-9952-4a84-803f-781446f538ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:47.377398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb85699-9952-4a84-803f-781446f538ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:47.378909 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb85699-9952-4a84-803f-781446f538ef service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:47.388806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1211/2404] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:47.702973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8829e8-164d-4697-a805-9e869b3899b3 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:47.704585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0e8829e8-164d-4697-a805-9e869b3899b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:47.722847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8829e8-164d-4697-a805-9e869b3899b3 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:47.733394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:47.735561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:47.736104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:47.736675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] PATH_INFO: `/v3/projects/b85c710bf7644734a8f326806155945e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:47.738440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b85c710bf7644734a8f326806155945e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:47.740932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:47.809974 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b85c710bf7644734a8f326806155945e', 'request_id': 'req-45276737-427d-42c3-aa53-ac0b8c7c42ee'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.818648 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b85c710bf7644734a8f326806155945e', 'request_id': 'req-45276737-427d-42c3-aa53-ac0b8c7c42ee'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.823240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:47.825567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b85c710bf7644734a8f326806155945e', 'request_id': 'req-45276737-427d-42c3-aa53-ac0b8c7c42ee'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.838982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] The token cache is being invalidate because project b85c710bf7644734a8f326806155945e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:47.839359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.840098 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.841824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1194/2405] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:47 2022] DELETE /identity/v3/projects/b85c710bf7644734a8f326806155945e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:47.845944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb85699-9952-4a84-803f-781446f538ef service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:47.856472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb85699-9952-4a84-803f-781446f538ef service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:47.916495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:47.917406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:47.917688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:47.917965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] PATH_INFO: `/v3/users/3d110598766c496b9716b88e23052d20` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:47.919184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d110598766c496b9716b88e23052d20)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:47.921341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:47.975462 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d110598766c496b9716b88e23052d20'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.976549 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d110598766c496b9716b88e23052d20'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.988767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d110598766c496b9716b88e23052d20'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.996172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d110598766c496b9716b88e23052d20'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:47.996886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d110598766c496b9716b88e23052d20'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.014949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1212/2406] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:47 2022] DELETE /identity/v3/users/3d110598766c496b9716b88e23052d20 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:48.290690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:48.292298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:48.307022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276737-427d-42c3-aa53-ac0b8c7c42ee admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:48.368188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:48.369065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:48.369343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:48.369619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] PATH_INFO: `/v3/projects/69810be18348432698ac76c5a1029a5a` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:48.370832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69810be18348432698ac76c5a1029a5a)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:48.372785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:48.422040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69810be18348432698ac76c5a1029a5a', 'request_id': 'req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.430890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69810be18348432698ac76c5a1029a5a', 'request_id': 'req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.436914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69810be18348432698ac76c5a1029a5a', 'request_id': 'req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.448729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] The token cache is being invalidate because project 69810be18348432698ac76c5a1029a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:48.449121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.449798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.451402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1195/2407] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:48 2022] DELETE /identity/v3/projects/69810be18348432698ac76c5a1029a5a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:48.455381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:48.457380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:48.470573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73b682e-bb80-4f48-86f5-44a847c48923 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:48.530161 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:48.537131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:48.538049 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:48.538801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:48.539106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] PATH_INFO: `/v3/users/f10dfee34ed54ccf8b527f691b4556f6` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:48.540967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f10dfee34ed54ccf8b527f691b4556f6)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:48.543288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:48.594392 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f10dfee34ed54ccf8b527f691b4556f6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.595067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f10dfee34ed54ccf8b527f691b4556f6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.603214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f10dfee34ed54ccf8b527f691b4556f6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.610241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f10dfee34ed54ccf8b527f691b4556f6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.610884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-445ec0d6-e1e6-42a6-9cd7-0261493f18ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f10dfee34ed54ccf8b527f691b4556f6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:48.627694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1213/2408] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:48:48 2022] DELETE /identity/v3/users/f10dfee34ed54ccf8b527f691b4556f6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:49.019339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:49.020851 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:49.043983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4b6b40-1ce0-4d24-8f6a-77b55487da03 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:49.111770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:49.112667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.112987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.113294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] PATH_INFO: `/v3/projects/bf7f0c7140bf452e89365c0d467026d2` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.115004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf7f0c7140bf452e89365c0d467026d2)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:49.116998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:49.148576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:49.178619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf7f0c7140bf452e89365c0d467026d2', 'request_id': 'req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:49.187294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf7f0c7140bf452e89365c0d467026d2', 'request_id': 'req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:49.193119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf7f0c7140bf452e89365c0d467026d2', 'request_id': 'req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:49.204671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] The token cache is being invalidate because project bf7f0c7140bf452e89365c0d467026d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:48:49.205128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:49.206069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ba0d4a6-1e7f-47d7-a22e-7799a895a0a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:48:49.207805 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1196/2409] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:48:49 2022] DELETE /identity/v3/projects/bf7f0c7140bf452e89365c0d467026d2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:48:49.215295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ff83-8398-45d9-9b1c-c7cb331ad1e4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.215701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ff83-8398-45d9-9b1c-c7cb331ad1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.215982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8ff83-8398-45d9-9b1c-c7cb331ad1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.237862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-24d8ff83-8398-45d9-9b1c-c7cb331ad1e4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:49.239112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-24d8ff83-8398-45d9-9b1c-c7cb331ad1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:49.325118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1214/2410] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:49.389606 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dbcd2-a341-4795-ac87-99143b191111 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.390458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dbcd2-a341-4795-ac87-99143b191111 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.390458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dbcd2-a341-4795-ac87-99143b191111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.413330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d96dbcd2-a341-4795-ac87-99143b191111 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:49.415088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d96dbcd2-a341-4795-ac87-99143b191111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:49.427380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1197/2411] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:49.432232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8ff83-8398-45d9-9b1c-c7cb331ad1e4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:49.443241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8ff83-8398-45d9-9b1c-c7cb331ad1e4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:49.450132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:49.450823 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.451101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.451374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.452159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:48:49.452466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:49.454170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:49.466988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1215/2412] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:48:49.471719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dbcd2-a341-4795-ac87-99143b191111 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:49.485665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dbcd2-a341-4795-ac87-99143b191111 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:49.492625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21454c1c-6b6d-4ab3-b337-8def737f2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:49.493311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21454c1c-6b6d-4ab3-b337-8def737f2a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.493595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21454c1c-6b6d-4ab3-b337-8def737f2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.493855 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21454c1c-6b6d-4ab3-b337-8def737f2a63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.494572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21454c1c-6b6d-4ab3-b337-8def737f2a63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:49.496536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21454c1c-6b6d-4ab3-b337-8def737f2a63 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:49.528237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1198/2413] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:48:49 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:49.532774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:49.543517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b39d6-8fa6-46e4-8084-c1e87c0db329 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:49.602742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df339-703c-4b4d-a6e3-c06440e4e7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:49.603327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df339-703c-4b4d-a6e3-c06440e4e7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.603628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df339-703c-4b4d-a6e3-c06440e4e7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.603910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89df339-703c-4b4d-a6e3-c06440e4e7c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.604603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89df339-703c-4b4d-a6e3-c06440e4e7c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:49.606534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89df339-703c-4b4d-a6e3-c06440e4e7c8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:49.615420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:49.632696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1216/2414] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:48:49 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:48:49.634028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21454c1c-6b6d-4ab3-b337-8def737f2a63 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:49.644555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21454c1c-6b6d-4ab3-b337-8def737f2a63 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:49.650546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe631-060d-4191-8ffe-cbd38fed44df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:49.651258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe631-060d-4191-8ffe-cbd38fed44df admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.651535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe631-060d-4191-8ffe-cbd38fed44df admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.651857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fe631-060d-4191-8ffe-cbd38fed44df admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.652597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fe631-060d-4191-8ffe-cbd38fed44df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:49.654228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fe631-060d-4191-8ffe-cbd38fed44df admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:49.665460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1199/2415] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:49.669821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df339-703c-4b4d-a6e3-c06440e4e7c8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:49.680683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89df339-703c-4b4d-a6e3-c06440e4e7c8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:49.685744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31973126-f0e1-41cf-9d0e-47d029216bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:49.686410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973126-f0e1-41cf-9d0e-47d029216bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.686692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973126-f0e1-41cf-9d0e-47d029216bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.686968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31973126-f0e1-41cf-9d0e-47d029216bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.687727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31973126-f0e1-41cf-9d0e-47d029216bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:49.689322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31973126-f0e1-41cf-9d0e-47d029216bd7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:49.700470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1217/2416] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:48:49.706179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe631-060d-4191-8ffe-cbd38fed44df admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:49.720616 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fe631-060d-4191-8ffe-cbd38fed44df admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:49.726720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:49.727731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.727996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.728276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] PATH_INFO: `/v3/projects/c82ef778036a414da7ce7487473c65ae/users/f725b867756247b3990534f32762ad12/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.743972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82ef778036a414da7ce7487473c65ae, user_id=f725b867756247b3990534f32762ad12, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:49.746630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:49.767483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1200/2417] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:48:49 2022] PUT /identity/v3/projects/c82ef778036a414da7ce7487473c65ae/users/f725b867756247b3990534f32762ad12/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:48:49.782907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41339d-8738-485d-abb4-baf14eeefb78 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.783250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41339d-8738-485d-abb4-baf14eeefb78 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.783689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41339d-8738-485d-abb4-baf14eeefb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:49.813071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4e41339d-8738-485d-abb4-baf14eeefb78 None None] MFA Rules not processed for user `f725b867756247b3990534f32762ad12`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:49.814334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4e41339d-8738-485d-abb4-baf14eeefb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:49.888467 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1218/2418] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:48:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:49.902602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:49.905889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:49.981643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d211fe4-a30c-430d-aa71-cf8298aa0ec6 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:49.988380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:49.989302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:49.989649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:49.989983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:50.000137 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:50.001622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:50.010740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1201/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:48:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:48:54.458907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2e267-d435-4331-8cf3-e17ff829c0a0 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:54.459456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2e267-d435-4331-8cf3-e17ff829c0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:54.459456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2e267-d435-4331-8cf3-e17ff829c0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:54.478632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6ce2e267-d435-4331-8cf3-e17ff829c0a0 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:48:54.479895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6ce2e267-d435-4331-8cf3-e17ff829c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:54.536719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1219/2420] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:48:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:48:54.589217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:48:54.590728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:48:54.643449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:48:54.671082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fa399-438c-4a79-b229-f4f3c21bee83 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:48:54.676559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e058927-ee07-4ff3-815a-f0761737f23b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:48:54.677216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e058927-ee07-4ff3-815a-f0761737f23b service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:48:54.677495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e058927-ee07-4ff3-815a-f0761737f23b service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:48:54.677764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e058927-ee07-4ff3-815a-f0761737f23b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:48:54.686951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e058927-ee07-4ff3-815a-f0761737f23b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:48:54.688103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e058927-ee07-4ff3-815a-f0761737f23b service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:48:54.696771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1202/2421] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:48:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:04.529764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=1,keystone:SELECT=64 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:04.692960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=10 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:10.279077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2e267-d435-4331-8cf3-e17ff829c0a0 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:10.282141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6ce2e267-d435-4331-8cf3-e17ff829c0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:10.346935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2e267-d435-4331-8cf3-e17ff829c0a0 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:10.351058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a2c3c-33c0-4ba8-afd1-2ad20cdbb640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:10.351774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2c3c-33c0-4ba8-afd1-2ad20cdbb640 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.352060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2c3c-33c0-4ba8-afd1-2ad20cdbb640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.352338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a2c3c-33c0-4ba8-afd1-2ad20cdbb640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.354150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-793a2c3c-33c0-4ba8-afd1-2ad20cdbb640 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:10.364546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a2c3c-33c0-4ba8-afd1-2ad20cdbb640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:10.366263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a2c3c-33c0-4ba8-afd1-2ad20cdbb640 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:10.374734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1220/2422] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:49:10.488622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08be7af-6c90-4a96-b92e-8fd3985f75a9 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.489266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08be7af-6c90-4a96-b92e-8fd3985f75a9 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.489266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08be7af-6c90-4a96-b92e-8fd3985f75a9 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.491291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1203/2423] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:49:10.498240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b7142-38a5-4202-8608-23bd940933b9 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.498557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b7142-38a5-4202-8608-23bd940933b9 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.498843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b7142-38a5-4202-8608-23bd940933b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.518570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bc0b7142-38a5-4202-8608-23bd940933b9 None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:10.519809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bc0b7142-38a5-4202-8608-23bd940933b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:10.595142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1221/2424] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:49:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:10.608141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08be7af-6c90-4a96-b92e-8fd3985f75a9 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:10.610111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a08be7af-6c90-4a96-b92e-8fd3985f75a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:10.677404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08be7af-6c90-4a96-b92e-8fd3985f75a9 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:10.682089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0dcca-626c-42de-a0a4-0467f9d54846 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:10.683068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0dcca-626c-42de-a0a4-0467f9d54846 service glance] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.683580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0dcca-626c-42de-a0a4-0467f9d54846 service glance] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.684133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0dcca-626c-42de-a0a4-0467f9d54846 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.696371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0dcca-626c-42de-a0a4-0467f9d54846 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:10.698125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0dcca-626c-42de-a0a4-0467f9d54846 service glance] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:10.709708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1204/2425] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:10.781771 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d445-99e8-4d8f-80eb-042a5498a465 None None] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.782095 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d445-99e8-4d8f-80eb-042a5498a465 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.782374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf08d445-99e8-4d8f-80eb-042a5498a465 None None] PATH_INFO: `/` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.783806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1222/2426] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:49:10.789164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4155d7-2b77-4ead-8ee9-48c311f8e347 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.789460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4155d7-2b77-4ead-8ee9-48c311f8e347 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.789742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4155d7-2b77-4ead-8ee9-48c311f8e347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.809607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-2b4155d7-2b77-4ead-8ee9-48c311f8e347 None None] MFA Rules not processed for user `bcdda7fcb39248c1a5a36ee699d23c73`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:10.810723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2b4155d7-2b77-4ead-8ee9-48c311f8e347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:10.818159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1205/2427] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:49:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:10.830688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08d445-99e8-4d8f-80eb-042a5498a465 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:10.842524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf08d445-99e8-4d8f-80eb-042a5498a465 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:10.846552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb88ff-ff07-4ef8-9c04-9cee29d265e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:10.847190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb88ff-ff07-4ef8-9c04-9cee29d265e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.847474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb88ff-ff07-4ef8-9c04-9cee29d265e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.847779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb88ff-ff07-4ef8-9c04-9cee29d265e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.856043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb88ff-ff07-4ef8-9c04-9cee29d265e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:10.857493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb88ff-ff07-4ef8-9c04-9cee29d265e2 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:10.865378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1223/2428] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:10.955955 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6bbc9-9d6b-4012-9ae9-bc5c1f131979 None None] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.956251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6bbc9-9d6b-4012-9ae9-bc5c1f131979 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.956529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6bbc9-9d6b-4012-9ae9-bc5c1f131979 None None] PATH_INFO: `/` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.957918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1206/2429] 10.222.0.64 () {54 vars in 921 bytes} [Tue Jul 12 13:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 13:49:10.963776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2dc1-d63f-4505-af7f-9acce89b7320 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:10.964148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2dc1-d63f-4505-af7f-9acce89b7320 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:10.964495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2dc1-d63f-4505-af7f-9acce89b7320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:10.984714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-aedd2dc1-d63f-4505-af7f-9acce89b7320 None None] MFA Rules not processed for user `6eb064e8062d4a4eb7a7974f7200c86f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:10.985956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-aedd2dc1-d63f-4505-af7f-9acce89b7320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:10.997470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1224/2430] 10.222.0.64 () {58 vars in 1018 bytes} [Tue Jul 12 13:49:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:11.008754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6bbc9-9d6b-4012-9ae9-bc5c1f131979 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:11.021789 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6bbc9-9d6b-4012-9ae9-bc5c1f131979 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:11.025766 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0402c2-204e-4534-8c17-71b462fcff95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:11.026493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0402c2-204e-4534-8c17-71b462fcff95 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:11.026783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0402c2-204e-4534-8c17-71b462fcff95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:11.027061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0402c2-204e-4534-8c17-71b462fcff95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:11.038917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0402c2-204e-4534-8c17-71b462fcff95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:11.040448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0402c2-204e-4534-8c17-71b462fcff95 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:11.051541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1207/2431] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:12.891257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0e24-0935-4a28-967f-81b55e3cc005 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:12.891800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0e24-0935-4a28-967f-81b55e3cc005 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:12.892028 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0e24-0935-4a28-967f-81b55e3cc005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:12.911519 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-de2e0e24-0935-4a28-967f-81b55e3cc005 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:12.912775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-de2e0e24-0935-4a28-967f-81b55e3cc005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:12.920224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1225/2432] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:49:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:12.932213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0402c2-204e-4534-8c17-71b462fcff95 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:12.948894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0402c2-204e-4534-8c17-71b462fcff95 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:12.954592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a5847-e906-4fa5-a33c-f54ed9bfdcad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:12.955036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a5847-e906-4fa5-a33c-f54ed9bfdcad service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:12.955321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a5847-e906-4fa5-a33c-f54ed9bfdcad service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:12.955617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a5847-e906-4fa5-a33c-f54ed9bfdcad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:12.964716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a5847-e906-4fa5-a33c-f54ed9bfdcad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:12.966341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a5847-e906-4fa5-a33c-f54ed9bfdcad service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:12.975726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1208/2433] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:49:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:22.906172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=69 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:22.972039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=41 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:30.146237 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e0e24-0935-4a28-967f-81b55e3cc005 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:30.252609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e0e24-0935-4a28-967f-81b55e3cc005 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:30.258277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:30.259162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:30.259444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:30.259742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] PATH_INFO: `/v3/users/f725b867756247b3990534f32762ad12` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:30.261007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f725b867756247b3990534f32762ad12)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:30.263022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:30.310791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f725b867756247b3990534f32762ad12'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:30.311483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f725b867756247b3990534f32762ad12'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:30.320056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f725b867756247b3990534f32762ad12'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:30.328698 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f725b867756247b3990534f32762ad12'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:30.329647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f725b867756247b3990534f32762ad12'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:30.358384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1226/2434] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:49:30 2022] DELETE /identity/v3/users/f725b867756247b3990534f32762ad12 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:49:30.362863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894756f4-d004-4965-9436-092a2383c961 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:30.363389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894756f4-d004-4965-9436-092a2383c961 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:30.363493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894756f4-d004-4965-9436-092a2383c961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:30.410252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-894756f4-d004-4965-9436-092a2383c961 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:30.411388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-894756f4-d004-4965-9436-092a2383c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:30.471036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1209/2435] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:30.480878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:30.482434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:30.525016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:30.560198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b002b2-039d-49cf-b090-3764dc947b8e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:30.564171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1e7f8-6b18-416f-94c6-11d44d70db97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:30.564804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e7f8-6b18-416f-94c6-11d44d70db97 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:30.565081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e7f8-6b18-416f-94c6-11d44d70db97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:30.565378 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1e7f8-6b18-416f-94c6-11d44d70db97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:30.576204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e7f8-6b18-416f-94c6-11d44d70db97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:30.577670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1e7f8-6b18-416f-94c6-11d44d70db97 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:30.587241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1227/2436] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:30.889895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894756f4-d004-4965-9436-092a2383c961 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:30.891440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-894756f4-d004-4965-9436-092a2383c961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:30.921321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894756f4-d004-4965-9436-092a2383c961 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:30.926046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:30.926926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:30.927208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:30.927482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] PATH_INFO: `/v3/projects/c82ef778036a414da7ce7487473c65ae` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:30.928705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82ef778036a414da7ce7487473c65ae)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:30.930656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:30.988870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82ef778036a414da7ce7487473c65ae', 'request_id': 'req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:31.003163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82ef778036a414da7ce7487473c65ae', 'request_id': 'req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:31.011159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82ef778036a414da7ce7487473c65ae', 'request_id': 'req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:31.024898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] The token cache is being invalidate because project c82ef778036a414da7ce7487473c65ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:49:31.025321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:31.026138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c4f0fa11-56cd-4e01-8b8d-e6e3e25e0a83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:31.027804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1210/2437] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:49:30 2022] DELETE /identity/v3/projects/c82ef778036a414da7ce7487473c65ae => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:49:31.033090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3260fb-475d-49ac-b277-789b7423b5e2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.033390 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3260fb-475d-49ac-b277-789b7423b5e2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.033673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3260fb-475d-49ac-b277-789b7423b5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.084201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4b3260fb-475d-49ac-b277-789b7423b5e2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:31.085413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4b3260fb-475d-49ac-b277-789b7423b5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:31.147136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1228/2438] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:31.161004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087e91-1984-449f-93c8-f11f5fbc89ef None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.161292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087e91-1984-449f-93c8-f11f5fbc89ef None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.161564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec087e91-1984-449f-93c8-f11f5fbc89ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.188801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ec087e91-1984-449f-93c8-f11f5fbc89ef None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:31.190338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ec087e91-1984-449f-93c8-f11f5fbc89ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:31.200578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1211/2439] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:31.205138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3260fb-475d-49ac-b277-789b7423b5e2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:31.216285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3260fb-475d-49ac-b277-789b7423b5e2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:31.221441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:31.222117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.222400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.222676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.223416 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:49:31.223761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:31.225364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:31.238706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1229/2440] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:49:31.243641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec087e91-1984-449f-93c8-f11f5fbc89ef None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:31.255250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec087e91-1984-449f-93c8-f11f5fbc89ef None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:31.261124 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f675b0-ec41-4d5f-8ec3-841330e44225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:31.261977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f675b0-ec41-4d5f-8ec3-841330e44225 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.262376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f675b0-ec41-4d5f-8ec3-841330e44225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.262878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f675b0-ec41-4d5f-8ec3-841330e44225 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.263528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f675b0-ec41-4d5f-8ec3-841330e44225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:31.265656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f675b0-ec41-4d5f-8ec3-841330e44225 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:31.295499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1212/2441] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:49:31 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:49:31.300251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:31.311047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cad851-fc27-4b45-bdde-e0565e1721cc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:31.374388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0167-2fe0-42fd-b2fc-8d80df3e5afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:31.375066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0167-2fe0-42fd-b2fc-8d80df3e5afa admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.375342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0167-2fe0-42fd-b2fc-8d80df3e5afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.375653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d0167-2fe0-42fd-b2fc-8d80df3e5afa admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.376361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d0167-2fe0-42fd-b2fc-8d80df3e5afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:31.378297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d0167-2fe0-42fd-b2fc-8d80df3e5afa admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:31.401317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1230/2442] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:49:31 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:49:31.405822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f675b0-ec41-4d5f-8ec3-841330e44225 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:31.416285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f675b0-ec41-4d5f-8ec3-841330e44225 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:31.427339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca055b4-2df0-452e-a7ed-c2e5cefb1af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:31.427996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca055b4-2df0-452e-a7ed-c2e5cefb1af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.428281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca055b4-2df0-452e-a7ed-c2e5cefb1af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.428547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca055b4-2df0-452e-a7ed-c2e5cefb1af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.429354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca055b4-2df0-452e-a7ed-c2e5cefb1af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:31.430982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca055b4-2df0-452e-a7ed-c2e5cefb1af1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:31.442981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1213/2443] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:49:31.447391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0167-2fe0-42fd-b2fc-8d80df3e5afa admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:31.458457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d0167-2fe0-42fd-b2fc-8d80df3e5afa admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:31.464399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0613426-6905-465a-af0f-e73d51b79b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:31.465066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0613426-6905-465a-af0f-e73d51b79b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.465346 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0613426-6905-465a-af0f-e73d51b79b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.465672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0613426-6905-465a-af0f-e73d51b79b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.466498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0613426-6905-465a-af0f-e73d51b79b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:31.468132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0613426-6905-465a-af0f-e73d51b79b5b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:31.478283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1231/2444] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:49:31.482604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca055b4-2df0-452e-a7ed-c2e5cefb1af1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:31.493840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca055b4-2df0-452e-a7ed-c2e5cefb1af1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:31.499206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:31.500134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.500418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.500689 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] PATH_INFO: `/v3/projects/150666bb3f374b7095b1ad0dd923a65e/users/b00dad2048064a0185653630b5511b06/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.515590 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=150666bb3f374b7095b1ad0dd923a65e, user_id=b00dad2048064a0185653630b5511b06, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:31.518308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:31.520656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:31.533950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1214/2445] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:49:31 2022] PUT /identity/v3/projects/150666bb3f374b7095b1ad0dd923a65e/users/b00dad2048064a0185653630b5511b06/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:49:31.539257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a94f2-2cf5-4a7b-9c73-0fe43f703f02 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.539638 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a94f2-2cf5-4a7b-9c73-0fe43f703f02 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.539926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a94f2-2cf5-4a7b-9c73-0fe43f703f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.552752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:31.558758 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4f7a94f2-2cf5-4a7b-9c73-0fe43f703f02 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:31.560235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4f7a94f2-2cf5-4a7b-9c73-0fe43f703f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:31.619394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1232/2446] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:31.629893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:31.632969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:31.697604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721adb9b-1332-4cb8-b486-d84cc0655b4e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:31.702045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:31.702715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:31.703056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:31.703234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:31.713126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:31.714547 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:31.724829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1215/2447] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:35.398680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94cf8a-2bc7-40df-aa79-8800a09b61ae None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:35.399176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94cf8a-2bc7-40df-aa79-8800a09b61ae None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:35.399281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b94cf8a-2bc7-40df-aa79-8800a09b61ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:35.452914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0b94cf8a-2bc7-40df-aa79-8800a09b61ae None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:35.454599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0b94cf8a-2bc7-40df-aa79-8800a09b61ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:35.536696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1233/2448] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 12 13:49:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:35.551215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:35.552837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:35.646044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05b4e91-d1c1-4644-b189-ab756ed5ccc8 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:35.652837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461f95-374c-4322-ba78-61ba7a8febc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:35.654034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461f95-374c-4322-ba78-61ba7a8febc0 service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:35.654610 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461f95-374c-4322-ba78-61ba7a8febc0 service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:35.655900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2461f95-374c-4322-ba78-61ba7a8febc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:35.668838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2461f95-374c-4322-ba78-61ba7a8febc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:35.670900 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2461f95-374c-4322-ba78-61ba7a8febc0 service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:35.703637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1216/2449] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:49:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:49:36.011255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec9857-42ac-4db6-b812-a99a21d63118 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:36.012058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec9857-42ac-4db6-b812-a99a21d63118 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:36.012559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec9857-42ac-4db6-b812-a99a21d63118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:36.081357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5dec9857-42ac-4db6-b812-a99a21d63118 None None] MFA Rules not processed for user `b00dad2048064a0185653630b5511b06`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:36.086202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5dec9857-42ac-4db6-b812-a99a21d63118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:36.179322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1234/2450] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:49:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:36.184300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461f95-374c-4322-ba78-61ba7a8febc0 service swift] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:36.197599 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2461f95-374c-4322-ba78-61ba7a8febc0 service swift] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:36.203236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f79a-9e30-4ad4-a110-4eb2e9d4deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:36.204361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f79a-9e30-4ad4-a110-4eb2e9d4deb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:36.204945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f79a-9e30-4ad4-a110-4eb2e9d4deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:36.205492 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20f79a-9e30-4ad4-a110-4eb2e9d4deb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:36.206420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f79a-9e30-4ad4-a110-4eb2e9d4deb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:36.209057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20f79a-9e30-4ad4-a110-4eb2e9d4deb5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:36.250670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1217/2451] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:49:36 2022] POST /identity/v3/projects => generated 371 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:49:36.254449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec9857-42ac-4db6-b812-a99a21d63118 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:36.272870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec9857-42ac-4db6-b812-a99a21d63118 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:36.309599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:36.356043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f9d7a-a7a9-466e-9b6d-0b57ad20333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:36.356877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f9d7a-a7a9-466e-9b6d-0b57ad20333f admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:36.357216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f9d7a-a7a9-466e-9b6d-0b57ad20333f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:36.357569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f9d7a-a7a9-466e-9b6d-0b57ad20333f admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:36.358315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f9d7a-a7a9-466e-9b6d-0b57ad20333f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:36.360329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161f9d7a-a7a9-466e-9b6d-0b57ad20333f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:36.387711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1235/2452] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:49:36 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:49:36.389407 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f79a-9e30-4ad4-a110-4eb2e9d4deb5 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:36.401237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20f79a-9e30-4ad4-a110-4eb2e9d4deb5 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:36.409221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6cb2e-97fd-454b-8aee-6d25ad7c5ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:36.409952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6cb2e-97fd-454b-8aee-6d25ad7c5ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:36.410242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6cb2e-97fd-454b-8aee-6d25ad7c5ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:36.410521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6cb2e-97fd-454b-8aee-6d25ad7c5ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:36.411288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6cb2e-97fd-454b-8aee-6d25ad7c5ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:36.412940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6cb2e-97fd-454b-8aee-6d25ad7c5ef4 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:36.424427 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1218/2453] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:49:36.428384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f9d7a-a7a9-466e-9b6d-0b57ad20333f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:36.438969 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f9d7a-a7a9-466e-9b6d-0b57ad20333f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:36.444652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12589a9-9d8f-49bf-a724-b54a66b2eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:36.446478 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12589a9-9d8f-49bf-a724-b54a66b2eef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:36.446835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12589a9-9d8f-49bf-a724-b54a66b2eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:36.447172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12589a9-9d8f-49bf-a724-b54a66b2eef6 admin admin] PATH_INFO: `/v3/projects/a69b7b59d1b94c9e97f6fddb0a804e55/users/174971069f8a4f66b2f45a861226a3e9/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:36.483290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12589a9-9d8f-49bf-a724-b54a66b2eef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69b7b59d1b94c9e97f6fddb0a804e55, user_id=174971069f8a4f66b2f45a861226a3e9, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:36.486955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12589a9-9d8f-49bf-a724-b54a66b2eef6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:36.506501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1236/2454] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:49:36 2022] PUT /identity/v3/projects/a69b7b59d1b94c9e97f6fddb0a804e55/users/174971069f8a4f66b2f45a861226a3e9/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:49:36.510654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6cb2e-97fd-454b-8aee-6d25ad7c5ef4 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:36.524222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6cb2e-97fd-454b-8aee-6d25ad7c5ef4 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:36.577293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:36.591256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4811065-87eb-40f2-9fec-de6ebf9400e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:36.592444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4811065-87eb-40f2-9fec-de6ebf9400e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:36.592904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4811065-87eb-40f2-9fec-de6ebf9400e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:36.593255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4811065-87eb-40f2-9fec-de6ebf9400e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:36.594002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4811065-87eb-40f2-9fec-de6ebf9400e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:36.595624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4811065-87eb-40f2-9fec-de6ebf9400e5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:36.606363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1219/2455] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:49:36.610918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12589a9-9d8f-49bf-a724-b54a66b2eef6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:36.621886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12589a9-9d8f-49bf-a724-b54a66b2eef6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:36.626813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:36.627768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:36.628055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:36.628332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] PATH_INFO: `/v3/projects/a69b7b59d1b94c9e97f6fddb0a804e55/users/174971069f8a4f66b2f45a861226a3e9/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:36.630351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69b7b59d1b94c9e97f6fddb0a804e55, user_id=174971069f8a4f66b2f45a861226a3e9, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:36.633061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:36.644408 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1237/2456] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:49:36 2022] PUT /identity/v3/projects/a69b7b59d1b94c9e97f6fddb0a804e55/users/174971069f8a4f66b2f45a861226a3e9/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:49:41.333368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337d9cd-4156-4ea8-bc41-9c5277880f63 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:41.333966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337d9cd-4156-4ea8-bc41-9c5277880f63 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:41.333966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337d9cd-4156-4ea8-bc41-9c5277880f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:41.360896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-3337d9cd-4156-4ea8-bc41-9c5277880f63 None None] MFA Rules not processed for user `174971069f8a4f66b2f45a861226a3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:41.362111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3337d9cd-4156-4ea8-bc41-9c5277880f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:41.431699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1220/2457] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:49:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:49:41.445929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:41.447871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:41.552285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b07c7c-4c61-450e-8994-f68c3a3a0507 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:41.558017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:41.558676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:41.558957 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:41.559214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:41.617387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:41.619628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:41.621718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:41.631735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1238/2458] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:42.769131 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b53d59-0f2c-4fad-93f3-313f88048649 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:42.769655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b53d59-0f2c-4fad-93f3-313f88048649 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:42.769655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b53d59-0f2c-4fad-93f3-313f88048649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:42.788006 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d7b53d59-0f2c-4fad-93f3-313f88048649 None None] MFA Rules not processed for user `b00dad2048064a0185653630b5511b06`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:49:42.789303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d7b53d59-0f2c-4fad-93f3-313f88048649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:42.796890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1221/2459] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:49:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:49:50.824661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:50.826244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:50.929628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02be58a7-ae54-4d9d-8ebf-2c6358763d99 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:50.934586 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:50.935372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:50.935730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:50.935953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:50.937993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:50.951303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:50.952972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:50.963251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1239/2460] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:52.782476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=42 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:49:56.352067 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b53d59-0f2c-4fad-93f3-313f88048649 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:56.418242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b53d59-0f2c-4fad-93f3-313f88048649 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:56.422952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:56.423620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:56.423921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:56.424197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:56.426319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:56.491162 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:56.492649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:56.502561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1222/2461] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:59.630210 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:59.631825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:59.645382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e7fb4-1162-437c-9bc4-02b07eaded94 service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:59.658434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:59.659253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:59.659343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:59.659640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:59.661666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:59.674603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:59.676297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:59.688064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1240/2462] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:49:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:49:59.691767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:59.693304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:49:59.706361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddb146-d447-4c4d-968f-d951091aa00e service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:49:59.712612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:49:59.713584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:49:59.713874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:49:59.714179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] PATH_INFO: `/v3/users/0c10f3ffc56c4743b65e55a8936bc0cd` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:49:59.715493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c10f3ffc56c4743b65e55a8936bc0cd)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:49:59.717530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:49:59.768538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c10f3ffc56c4743b65e55a8936bc0cd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:59.778433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c10f3ffc56c4743b65e55a8936bc0cd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:59.779039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c10f3ffc56c4743b65e55a8936bc0cd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:59.787216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c10f3ffc56c4743b65e55a8936bc0cd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:59.799728 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a53578c-1772-41ff-bdc5-e9ba7c2de436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c10f3ffc56c4743b65e55a8936bc0cd'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:49:59.806560 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1223/2463] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:49:59 2022] DELETE /identity/v3/users/0c10f3ffc56c4743b65e55a8936bc0cd => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:49:59.987492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:49:59.999811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af3c47-e0c4-47da-8fca-0e2b3ef3109f service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.057225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.058094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.058355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.058626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] PATH_INFO: `/v3/projects/f2e5aebea64a4bd0bf55ef95ee2b446c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.059916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2e5aebea64a4bd0bf55ef95ee2b446c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.061821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.109340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2e5aebea64a4bd0bf55ef95ee2b446c', 'request_id': 'req-c744e588-487f-4e50-8c38-3b84208a787d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:00.115423 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2e5aebea64a4bd0bf55ef95ee2b446c', 'request_id': 'req-c744e588-487f-4e50-8c38-3b84208a787d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:00.117112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:00.124425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2e5aebea64a4bd0bf55ef95ee2b446c', 'request_id': 'req-c744e588-487f-4e50-8c38-3b84208a787d'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:00.135124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] The token cache is being invalidate because project f2e5aebea64a4bd0bf55ef95ee2b446c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:00.135411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:00.136065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c744e588-487f-4e50-8c38-3b84208a787d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:00.137619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1241/2464] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:49:59 2022] DELETE /identity/v3/projects/f2e5aebea64a4bd0bf55ef95ee2b446c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:00.142711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8410525-2cc8-4737-afd3-39e4ffb8964d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.143020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8410525-2cc8-4737-afd3-39e4ffb8964d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.143298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8410525-2cc8-4737-afd3-39e4ffb8964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.161023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d8410525-2cc8-4737-afd3-39e4ffb8964d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:00.162223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d8410525-2cc8-4737-afd3-39e4ffb8964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:00.171181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:00.225259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1224/2465] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:00.233825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffff5de-a02d-4bdb-8728-6ff02b5c2cde None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.234108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffff5de-a02d-4bdb-8728-6ff02b5c2cde None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.234381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffff5de-a02d-4bdb-8728-6ff02b5c2cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.252624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9ffff5de-a02d-4bdb-8728-6ff02b5c2cde None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:00.253824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9ffff5de-a02d-4bdb-8728-6ff02b5c2cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:00.267333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1242/2466] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:00.271803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8410525-2cc8-4737-afd3-39e4ffb8964d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.282160 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8410525-2cc8-4737-afd3-39e4ffb8964d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.287530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.288235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.288519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.288796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.289534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:00.289844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.291474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.303664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1225/2467] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:00.308022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffff5de-a02d-4bdb-8728-6ff02b5c2cde None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.317799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffff5de-a02d-4bdb-8728-6ff02b5c2cde None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.324085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb21c72-c3ff-4b7d-a97c-418cb727c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.324763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21c72-c3ff-4b7d-a97c-418cb727c135 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.325039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21c72-c3ff-4b7d-a97c-418cb727c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.325303 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb21c72-c3ff-4b7d-a97c-418cb727c135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.326000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb21c72-c3ff-4b7d-a97c-418cb727c135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.327946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb21c72-c3ff-4b7d-a97c-418cb727c135 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.357534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1243/2468] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:00 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:00.363007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.376266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2fdc1-7bf6-41dc-85e7-e48856307675 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.439114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc886210-0a91-4dac-bbe7-2ff6e3300fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.439845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886210-0a91-4dac-bbe7-2ff6e3300fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.440130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886210-0a91-4dac-bbe7-2ff6e3300fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.440447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886210-0a91-4dac-bbe7-2ff6e3300fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.441229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886210-0a91-4dac-bbe7-2ff6e3300fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.443166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886210-0a91-4dac-bbe7-2ff6e3300fe7 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.465904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1226/2469] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:00 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:00.470202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb21c72-c3ff-4b7d-a97c-418cb727c135 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.480843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb21c72-c3ff-4b7d-a97c-418cb727c135 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.485513 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf2dc2-0d1a-4ef6-8d33-2bfc11d41deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.486186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2dc2-0d1a-4ef6-8d33-2bfc11d41deb admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.486470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2dc2-0d1a-4ef6-8d33-2bfc11d41deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.486750 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf2dc2-0d1a-4ef6-8d33-2bfc11d41deb admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.487523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf2dc2-0d1a-4ef6-8d33-2bfc11d41deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.489399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf2dc2-0d1a-4ef6-8d33-2bfc11d41deb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.500960 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1244/2470] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:00.504339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc886210-0a91-4dac-bbe7-2ff6e3300fe7 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.514285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc886210-0a91-4dac-bbe7-2ff6e3300fe7 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.520057 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb27297-5aa1-4ee4-96bc-1d923ba2bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.520724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27297-5aa1-4ee4-96bc-1d923ba2bc2c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.521005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27297-5aa1-4ee4-96bc-1d923ba2bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.521273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb27297-5aa1-4ee4-96bc-1d923ba2bc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.522026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27297-5aa1-4ee4-96bc-1d923ba2bc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.523587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb27297-5aa1-4ee4-96bc-1d923ba2bc2c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.534480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1227/2471] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:00.538725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf2dc2-0d1a-4ef6-8d33-2bfc11d41deb admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.548822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf2dc2-0d1a-4ef6-8d33-2bfc11d41deb admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.554192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eec3b7-8074-49ac-b2b0-afd6ce768db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.555087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec3b7-8074-49ac-b2b0-afd6ce768db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.555357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec3b7-8074-49ac-b2b0-afd6ce768db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.555640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eec3b7-8074-49ac-b2b0-afd6ce768db8 admin admin] PATH_INFO: `/v3/projects/7f13f7d0260a4ba1918c1cc109b115f3/users/d0be476684f84bbc9a246bcd16a715e1/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.571637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eec3b7-8074-49ac-b2b0-afd6ce768db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f13f7d0260a4ba1918c1cc109b115f3, user_id=d0be476684f84bbc9a246bcd16a715e1, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.574609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eec3b7-8074-49ac-b2b0-afd6ce768db8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.593047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1245/2472] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:00 2022] PUT /identity/v3/projects/7f13f7d0260a4ba1918c1cc109b115f3/users/d0be476684f84bbc9a246bcd16a715e1/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:00.603977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e554-7bad-4a00-9e2f-7e3e3a3c8c42 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.604268 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e554-7bad-4a00-9e2f-7e3e3a3c8c42 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.604568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c0e554-7bad-4a00-9e2f-7e3e3a3c8c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.631916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-27c0e554-7bad-4a00-9e2f-7e3e3a3c8c42 None None] MFA Rules not processed for user `d0be476684f84bbc9a246bcd16a715e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:00.633228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-27c0e554-7bad-4a00-9e2f-7e3e3a3c8c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:00.705009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1228/2473] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:00.709690 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eec3b7-8074-49ac-b2b0-afd6ce768db8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.774574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eec3b7-8074-49ac-b2b0-afd6ce768db8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.780506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658b63-64ce-4ce1-bfc5-7ac4e7dd8494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.781169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658b63-64ce-4ce1-bfc5-7ac4e7dd8494 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.781495 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658b63-64ce-4ce1-bfc5-7ac4e7dd8494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.781798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43658b63-64ce-4ce1-bfc5-7ac4e7dd8494 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.782470 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658b63-64ce-4ce1-bfc5-7ac4e7dd8494 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.784436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43658b63-64ce-4ce1-bfc5-7ac4e7dd8494 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.810619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1246/2474] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:00 2022] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:00.814836 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0e554-7bad-4a00-9e2f-7e3e3a3c8c42 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.826591 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c0e554-7bad-4a00-9e2f-7e3e3a3c8c42 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.831583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:00.894299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93196b03-8ccb-402b-ac8d-565181c505c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.895087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93196b03-8ccb-402b-ac8d-565181c505c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.895478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93196b03-8ccb-402b-ac8d-565181c505c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.895886 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93196b03-8ccb-402b-ac8d-565181c505c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.896904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93196b03-8ccb-402b-ac8d-565181c505c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.899960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93196b03-8ccb-402b-ac8d-565181c505c8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.924679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1229/2475] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:00 2022] POST /identity/v3/users => generated 292 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:00.928815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658b63-64ce-4ce1-bfc5-7ac4e7dd8494 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.939284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43658b63-64ce-4ce1-bfc5-7ac4e7dd8494 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.944740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d0d67-20cb-483a-a537-21881f481833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.945411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d0d67-20cb-483a-a537-21881f481833 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.945694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d0d67-20cb-483a-a537-21881f481833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.945970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266d0d67-20cb-483a-a537-21881f481833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:00.946707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d0d67-20cb-483a-a537-21881f481833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:00.948354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266d0d67-20cb-483a-a537-21881f481833 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:00.959594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1247/2476] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:50:00.963960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93196b03-8ccb-402b-ac8d-565181c505c8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:00.974500 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93196b03-8ccb-402b-ac8d-565181c505c8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:00.981053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1474f-2f47-4a6d-b789-eca1bad41219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:00.982556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1474f-2f47-4a6d-b789-eca1bad41219 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:00.982850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1474f-2f47-4a6d-b789-eca1bad41219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:00.983208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1474f-2f47-4a6d-b789-eca1bad41219 admin admin] PATH_INFO: `/v3/projects/3a0b9bf80c894f199b8a80819f6f9c9c/users/24255841e9ee4aec8d27502462333dc9/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:01.003994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1474f-2f47-4a6d-b789-eca1bad41219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b9bf80c894f199b8a80819f6f9c9c, user_id=24255841e9ee4aec8d27502462333dc9, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:01.006661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1474f-2f47-4a6d-b789-eca1bad41219 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:01.021673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1230/2477] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:00 2022] PUT /identity/v3/projects/3a0b9bf80c894f199b8a80819f6f9c9c/users/24255841e9ee4aec8d27502462333dc9/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:01.025987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d0d67-20cb-483a-a537-21881f481833 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:01.036417 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266d0d67-20cb-483a-a537-21881f481833 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:01.085022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:01.095693 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d147f092-67cf-4310-8483-374b09445ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:01.096395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147f092-67cf-4310-8483-374b09445ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:01.096711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147f092-67cf-4310-8483-374b09445ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:01.097160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d147f092-67cf-4310-8483-374b09445ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:01.097895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147f092-67cf-4310-8483-374b09445ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:01.099501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d147f092-67cf-4310-8483-374b09445ad7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:01.109285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1248/2478] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:01.113482 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1474f-2f47-4a6d-b789-eca1bad41219 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:01.124075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1474f-2f47-4a6d-b789-eca1bad41219 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:01.129024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:01.129916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:01.130195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:01.130462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] PATH_INFO: `/v3/projects/3a0b9bf80c894f199b8a80819f6f9c9c/users/24255841e9ee4aec8d27502462333dc9/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:01.132603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0b9bf80c894f199b8a80819f6f9c9c, user_id=24255841e9ee4aec8d27502462333dc9, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:01.135187 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:01.145786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1231/2479] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:01 2022] PUT /identity/v3/projects/3a0b9bf80c894f199b8a80819f6f9c9c/users/24255841e9ee4aec8d27502462333dc9/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:01.155887 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104d3c-3856-41d0-98ed-54bf035c58f7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:01.156174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104d3c-3856-41d0-98ed-54bf035c58f7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:01.156447 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f104d3c-3856-41d0-98ed-54bf035c58f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:01.182019 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8f104d3c-3856-41d0-98ed-54bf035c58f7 None None] MFA Rules not processed for user `24255841e9ee4aec8d27502462333dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:01.183233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8f104d3c-3856-41d0-98ed-54bf035c58f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:01.253062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1249/2480] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:01.264598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:01.266555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:01.354931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91da9e2-3b14-4085-b059-f17500af7674 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:01.359519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ff0f7-b5f9-439f-a320-8e551a456972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:01.360239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff0f7-b5f9-439f-a320-8e551a456972 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:01.360550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff0f7-b5f9-439f-a320-8e551a456972 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:01.360829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ff0f7-b5f9-439f-a320-8e551a456972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:01.370915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ff0f7-b5f9-439f-a320-8e551a456972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:01.372403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ff0f7-b5f9-439f-a320-8e551a456972 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:01.382350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1232/2481] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:01 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:01.783848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104d3c-3856-41d0-98ed-54bf035c58f7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:01.848040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f104d3c-3856-41d0-98ed-54bf035c58f7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:01.852819 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03532445-430e-415f-a211-6111af54df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:01.853707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03532445-430e-415f-a211-6111af54df78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:01.854035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03532445-430e-415f-a211-6111af54df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:01.854240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03532445-430e-415f-a211-6111af54df78 admin admin] PATH_INFO: `/v3/users/d0be476684f84bbc9a246bcd16a715e1` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:01.855507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03532445-430e-415f-a211-6111af54df78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0be476684f84bbc9a246bcd16a715e1)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:01.857451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03532445-430e-415f-a211-6111af54df78 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:01.908330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03532445-430e-415f-a211-6111af54df78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0be476684f84bbc9a246bcd16a715e1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:01.909009 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03532445-430e-415f-a211-6111af54df78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0be476684f84bbc9a246bcd16a715e1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:01.917011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03532445-430e-415f-a211-6111af54df78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0be476684f84bbc9a246bcd16a715e1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:01.923836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03532445-430e-415f-a211-6111af54df78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0be476684f84bbc9a246bcd16a715e1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:01.924471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-03532445-430e-415f-a211-6111af54df78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0be476684f84bbc9a246bcd16a715e1'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:01.934864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:01.946141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1250/2482] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:01 2022] DELETE /identity/v3/users/d0be476684f84bbc9a246bcd16a715e1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:01.951426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48804091-244d-4bdb-89dd-6fb7d4d4c164 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:01.951947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48804091-244d-4bdb-89dd-6fb7d4d4c164 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:01.952032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48804091-244d-4bdb-89dd-6fb7d4d4c164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:01.970332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-48804091-244d-4bdb-89dd-6fb7d4d4c164 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:01.971707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-48804091-244d-4bdb-89dd-6fb7d4d4c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:02.019540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:02.044533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1233/2483] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:02.054878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03532445-430e-415f-a211-6111af54df78 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:02.056789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-03532445-430e-415f-a211-6111af54df78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:02.145159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03532445-430e-415f-a211-6111af54df78 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:02.148791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50dfd5-6c2f-4c95-a308-144e482102b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:02.149451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50dfd5-6c2f-4c95-a308-144e482102b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:02.149731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50dfd5-6c2f-4c95-a308-144e482102b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:02.150001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c50dfd5-6c2f-4c95-a308-144e482102b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:02.163080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50dfd5-6c2f-4c95-a308-144e482102b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:02.164594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c50dfd5-6c2f-4c95-a308-144e482102b3 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:02.179167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1251/2484] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:02.497223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48804091-244d-4bdb-89dd-6fb7d4d4c164 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:02.498832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-48804091-244d-4bdb-89dd-6fb7d4d4c164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:02.512526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48804091-244d-4bdb-89dd-6fb7d4d4c164 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:02.520919 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:02.522225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:02.522576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:02.522927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] PATH_INFO: `/v3/projects/7f13f7d0260a4ba1918c1cc109b115f3` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:02.524302 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f13f7d0260a4ba1918c1cc109b115f3)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:02.526305 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:02.586734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f13f7d0260a4ba1918c1cc109b115f3', 'request_id': 'req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.593968 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f13f7d0260a4ba1918c1cc109b115f3', 'request_id': 'req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.600499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f13f7d0260a4ba1918c1cc109b115f3', 'request_id': 'req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.612397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] The token cache is being invalidate because project 7f13f7d0260a4ba1918c1cc109b115f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:02.613699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.614734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.616563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1234/2485] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:02 2022] DELETE /identity/v3/projects/7f13f7d0260a4ba1918c1cc109b115f3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:02.620622 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50dfd5-6c2f-4c95-a308-144e482102b3 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:02.635986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c50dfd5-6c2f-4c95-a308-144e482102b3 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:02.699994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:02.700808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:02.701092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:02.701399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] PATH_INFO: `/v3/users/24255841e9ee4aec8d27502462333dc9` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:02.702632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24255841e9ee4aec8d27502462333dc9)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:02.704747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:02.751527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24255841e9ee4aec8d27502462333dc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.752248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24255841e9ee4aec8d27502462333dc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.759928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24255841e9ee4aec8d27502462333dc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.766906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24255841e9ee4aec8d27502462333dc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.767566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c4f17cc4-3de4-4174-b0b6-252a8394a881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24255841e9ee4aec8d27502462333dc9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:02.785151 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1252/2486] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:02 2022] DELETE /identity/v3/users/24255841e9ee4aec8d27502462333dc9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:03.152453 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:03.154444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:03.169617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b00cc-3afd-4c99-92fe-3bcc973b39bc admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:03.238993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:03.240054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.240351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.240664 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] PATH_INFO: `/v3/projects/3a0b9bf80c894f199b8a80819f6f9c9c` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.242248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0b9bf80c894f199b8a80819f6f9c9c)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:03.244351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:03.302438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0b9bf80c894f199b8a80819f6f9c9c', 'request_id': 'req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:03.310523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0b9bf80c894f199b8a80819f6f9c9c', 'request_id': 'req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:03.316647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0b9bf80c894f199b8a80819f6f9c9c', 'request_id': 'req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:03.324907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:03.330034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] The token cache is being invalidate because project 3a0b9bf80c894f199b8a80819f6f9c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:03.330678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:03.331704 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6ea12ec2-62c0-49e2-81b3-8c7535383ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:03.333586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1235/2487] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:03 2022] DELETE /identity/v3/projects/3a0b9bf80c894f199b8a80819f6f9c9c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:03.338922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9eb0c-570b-463d-91aa-7ed28f3cc6fa None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.339299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9eb0c-570b-463d-91aa-7ed28f3cc6fa None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.339674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a9eb0c-570b-463d-91aa-7ed28f3cc6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.347287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:03.358827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-33a9eb0c-570b-463d-91aa-7ed28f3cc6fa None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:03.360472 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-33a9eb0c-570b-463d-91aa-7ed28f3cc6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:03.422875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1253/2488] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:03.433188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12047-e0e2-4291-af25-30916be5f1e7 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.433506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12047-e0e2-4291-af25-30916be5f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.433791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c12047-e0e2-4291-af25-30916be5f1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.456340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e2c12047-e0e2-4291-af25-30916be5f1e7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:03.457745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e2c12047-e0e2-4291-af25-30916be5f1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:03.469836 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1236/2489] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:03.471059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9eb0c-570b-463d-91aa-7ed28f3cc6fa None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:03.481949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a9eb0c-570b-463d-91aa-7ed28f3cc6fa None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:03.487047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:03.487863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.488051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.488285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.490588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:03.490588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:03.491092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:03.504093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1254/2490] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:03.508549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12047-e0e2-4291-af25-30916be5f1e7 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:03.517999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c12047-e0e2-4291-af25-30916be5f1e7 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:03.523061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588d2cb-be18-44ad-bf52-0025b84c1029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:03.523767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d2cb-be18-44ad-bf52-0025b84c1029 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.524049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d2cb-be18-44ad-bf52-0025b84c1029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.524322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588d2cb-be18-44ad-bf52-0025b84c1029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.525036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588d2cb-be18-44ad-bf52-0025b84c1029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:03.526956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588d2cb-be18-44ad-bf52-0025b84c1029 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:03.558785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1237/2491] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:03 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:03.562811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:03.576411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5604370-c369-4798-a348-a387c6b792e5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:03.658319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d83b3-ac9a-49c6-90d4-8e8344c8b42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:03.659438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d83b3-ac9a-49c6-90d4-8e8344c8b42c admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.659438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d83b3-ac9a-49c6-90d4-8e8344c8b42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.663661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d83b3-ac9a-49c6-90d4-8e8344c8b42c admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.664524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d83b3-ac9a-49c6-90d4-8e8344c8b42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:03.666477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6d83b3-ac9a-49c6-90d4-8e8344c8b42c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:03.695779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1255/2492] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:03 2022] POST /identity/v3/users => generated 282 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:03.700800 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588d2cb-be18-44ad-bf52-0025b84c1029 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:03.714295 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588d2cb-be18-44ad-bf52-0025b84c1029 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:03.721095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe50d65-5244-48d0-9be3-30816a289b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:03.721817 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe50d65-5244-48d0-9be3-30816a289b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.722172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe50d65-5244-48d0-9be3-30816a289b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.722452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe50d65-5244-48d0-9be3-30816a289b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.723501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe50d65-5244-48d0-9be3-30816a289b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:03.724879 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe50d65-5244-48d0-9be3-30816a289b0b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:03.737261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1238/2493] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:03.741389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d83b3-ac9a-49c6-90d4-8e8344c8b42c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:03.751572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d83b3-ac9a-49c6-90d4-8e8344c8b42c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:03.756163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78671e66-87c9-454a-b0a5-7dd12265615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:03.756836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671e66-87c9-454a-b0a5-7dd12265615b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.757112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671e66-87c9-454a-b0a5-7dd12265615b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.757383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78671e66-87c9-454a-b0a5-7dd12265615b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.758116 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78671e66-87c9-454a-b0a5-7dd12265615b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:03.759723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78671e66-87c9-454a-b0a5-7dd12265615b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:03.770334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1256/2494] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:50:03.775157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe50d65-5244-48d0-9be3-30816a289b0b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:03.786590 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe50d65-5244-48d0-9be3-30816a289b0b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:03.791526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3beb-978c-43d4-ad51-a1e0445feb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:03.792477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3beb-978c-43d4-ad51-a1e0445feb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.792756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3beb-978c-43d4-ad51-a1e0445feb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.793029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf3beb-978c-43d4-ad51-a1e0445feb8b admin admin] PATH_INFO: `/v3/projects/45e895cee22648419a601f5015f55b0b/users/91da064eee3642df96ace2e564480e84/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.808825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3beb-978c-43d4-ad51-a1e0445feb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e895cee22648419a601f5015f55b0b, user_id=91da064eee3642df96ace2e564480e84, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:03.811572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf3beb-978c-43d4-ad51-a1e0445feb8b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:03.825908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1239/2495] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:03 2022] PUT /identity/v3/projects/45e895cee22648419a601f5015f55b0b/users/91da064eee3642df96ace2e564480e84/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:03.837443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00104-7443-4aeb-898e-e3cb5e901978 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:03.837949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00104-7443-4aeb-898e-e3cb5e901978 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:03.838048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb00104-7443-4aeb-898e-e3cb5e901978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:03.869599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-1cb00104-7443-4aeb-898e-e3cb5e901978 None None] MFA Rules not processed for user `91da064eee3642df96ace2e564480e84`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:03.871187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1cb00104-7443-4aeb-898e-e3cb5e901978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:03.942621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:03.946176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1257/2496] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:03 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:03.951300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3beb-978c-43d4-ad51-a1e0445feb8b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:04.025005 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf3beb-978c-43d4-ad51-a1e0445feb8b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:04.029843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee70021-6b55-428d-b307-c691589b4a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:04.030538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70021-6b55-428d-b307-c691589b4a93 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.030816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70021-6b55-428d-b307-c691589b4a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.031085 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70021-6b55-428d-b307-c691589b4a93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.031939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee70021-6b55-428d-b307-c691589b4a93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:04.033861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee70021-6b55-428d-b307-c691589b4a93 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:04.074928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1240/2497] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:03 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:04.075726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00104-7443-4aeb-898e-e3cb5e901978 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:04.087165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb00104-7443-4aeb-898e-e3cb5e901978 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:04.141560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5728f-dc92-446c-bd64-4099e10d47df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:04.142163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5728f-dc92-446c-bd64-4099e10d47df admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.142443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5728f-dc92-446c-bd64-4099e10d47df admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.142719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5728f-dc92-446c-bd64-4099e10d47df admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.143425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5728f-dc92-446c-bd64-4099e10d47df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:04.145389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5728f-dc92-446c-bd64-4099e10d47df admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:04.165789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1258/2498] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:04 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:04.169854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee70021-6b55-428d-b307-c691589b4a93 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:04.180415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee70021-6b55-428d-b307-c691589b4a93 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:04.185969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cfbe7-b7a4-4c43-b65d-95d0f8da743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:04.186658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cfbe7-b7a4-4c43-b65d-95d0f8da743b admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.186970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cfbe7-b7a4-4c43-b65d-95d0f8da743b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.187251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cfbe7-b7a4-4c43-b65d-95d0f8da743b admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.197760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cfbe7-b7a4-4c43-b65d-95d0f8da743b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:04.199773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cfbe7-b7a4-4c43-b65d-95d0f8da743b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:04.210912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1241/2499] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:04.215208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5728f-dc92-446c-bd64-4099e10d47df admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:04.225221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5728f-dc92-446c-bd64-4099e10d47df admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:04.229999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994754c1-3ab8-4014-b246-e20bf83857ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:04.230900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994754c1-3ab8-4014-b246-e20bf83857ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.231182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994754c1-3ab8-4014-b246-e20bf83857ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.231459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994754c1-3ab8-4014-b246-e20bf83857ce admin admin] PATH_INFO: `/v3/projects/2d5b13f8bfea43aa8dded73775d22850/users/7f4672baa67d49968a20963cf5a31a58/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.250977 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994754c1-3ab8-4014-b246-e20bf83857ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5b13f8bfea43aa8dded73775d22850, user_id=7f4672baa67d49968a20963cf5a31a58, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:04.253687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994754c1-3ab8-4014-b246-e20bf83857ce admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:04.270585 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1259/2500] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:04 2022] PUT /identity/v3/projects/2d5b13f8bfea43aa8dded73775d22850/users/7f4672baa67d49968a20963cf5a31a58/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:04.274749 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cfbe7-b7a4-4c43-b65d-95d0f8da743b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:04.289340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cfbe7-b7a4-4c43-b65d-95d0f8da743b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:04.412487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103a8e0-6069-4d25-85c8-9c2bffd9d004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:04.414038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103a8e0-6069-4d25-85c8-9c2bffd9d004 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.414540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103a8e0-6069-4d25-85c8-9c2bffd9d004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.415059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103a8e0-6069-4d25-85c8-9c2bffd9d004 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.415972 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103a8e0-6069-4d25-85c8-9c2bffd9d004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:04.421392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103a8e0-6069-4d25-85c8-9c2bffd9d004 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:04.449513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1242/2501] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:04.450675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994754c1-3ab8-4014-b246-e20bf83857ce admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:04.469251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994754c1-3ab8-4014-b246-e20bf83857ce admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:04.474980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:04.476137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.476699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.477223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] PATH_INFO: `/v3/projects/2d5b13f8bfea43aa8dded73775d22850/users/7f4672baa67d49968a20963cf5a31a58/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.479629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5b13f8bfea43aa8dded73775d22850, user_id=7f4672baa67d49968a20963cf5a31a58, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:04.482624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:04.495075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1260/2502] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:04 2022] PUT /identity/v3/projects/2d5b13f8bfea43aa8dded73775d22850/users/7f4672baa67d49968a20963cf5a31a58/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:04.511315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a033a-6a38-4b83-98d9-26f7d272bdbe None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.511680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a033a-6a38-4b83-98d9-26f7d272bdbe None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.512025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a033a-6a38-4b83-98d9-26f7d272bdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.520450 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:04.546157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f08a033a-6a38-4b83-98d9-26f7d272bdbe None None] MFA Rules not processed for user `7f4672baa67d49968a20963cf5a31a58`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:04.547538 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f08a033a-6a38-4b83-98d9-26f7d272bdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:04.647042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1243/2503] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:04.656763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:04.658649 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:04.725703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c78d58-604b-4e90-85ac-74e006168d8e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:04.729661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4e66b-03de-4efd-ae36-f557aad58b57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:04.731264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e66b-03de-4efd-ae36-f557aad58b57 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.731264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e66b-03de-4efd-ae36-f557aad58b57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.731264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a4e66b-03de-4efd-ae36-f557aad58b57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.741089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4e66b-03de-4efd-ae36-f557aad58b57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:04.742640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a4e66b-03de-4efd-ae36-f557aad58b57 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:04.753487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1261/2504] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:04.844284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a033a-6a38-4b83-98d9-26f7d272bdbe None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:04.854043 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a033a-6a38-4b83-98d9-26f7d272bdbe None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:04.857697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe0a5f-b83d-4337-a1be-cedda2f20f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:04.858352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe0a5f-b83d-4337-a1be-cedda2f20f6e service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:04.858638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe0a5f-b83d-4337-a1be-cedda2f20f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:04.858913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe0a5f-b83d-4337-a1be-cedda2f20f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:04.916778 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe0a5f-b83d-4337-a1be-cedda2f20f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:04.918208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe0a5f-b83d-4337-a1be-cedda2f20f6e service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:04.927363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1244/2505] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:04 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:07.648503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4e66b-03de-4efd-ae36-f557aad58b57 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:07.707309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:07.712900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a4e66b-03de-4efd-ae36-f557aad58b57 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:07.718645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:07.719742 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:07.719902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:07.720184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] PATH_INFO: `/v3/users/91da064eee3642df96ace2e564480e84` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:07.721398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91da064eee3642df96ace2e564480e84)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:07.723356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:07.772599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91da064eee3642df96ace2e564480e84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:07.773535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91da064eee3642df96ace2e564480e84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:07.783097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91da064eee3642df96ace2e564480e84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:07.792359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91da064eee3642df96ace2e564480e84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:07.793186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91da064eee3642df96ace2e564480e84'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:07.811979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1262/2506] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:07 2022] DELETE /identity/v3/users/91da064eee3642df96ace2e564480e84 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:07.816300 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f9754-adca-4986-8df3-7d8c92fcdb7c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:07.817200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f9754-adca-4986-8df3-7d8c92fcdb7c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:07.817882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8f9754-adca-4986-8df3-7d8c92fcdb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:07.837912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-bc8f9754-adca-4986-8df3-7d8c92fcdb7c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:07.839219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-bc8f9754-adca-4986-8df3-7d8c92fcdb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:07.906705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1245/2507] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:07.917076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:07.918718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:07.979869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57302d2c-d82a-4ca0-84eb-06dba11e2bd8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:07.983654 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d1d17-b4ba-4325-98be-de941a746928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:07.984440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d1d17-b4ba-4325-98be-de941a746928 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:07.984725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d1d17-b4ba-4325-98be-de941a746928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:07.985003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076d1d17-b4ba-4325-98be-de941a746928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:07.994215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d1d17-b4ba-4325-98be-de941a746928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:07.995684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076d1d17-b4ba-4325-98be-de941a746928 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:08.008029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1263/2508] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:08.285815 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f9754-adca-4986-8df3-7d8c92fcdb7c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:08.287818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-bc8f9754-adca-4986-8df3-7d8c92fcdb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:08.300573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8f9754-adca-4986-8df3-7d8c92fcdb7c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:08.305907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:08.306791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:08.307079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:08.307344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] PATH_INFO: `/v3/projects/45e895cee22648419a601f5015f55b0b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:08.308734 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e895cee22648419a601f5015f55b0b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:08.310663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:08.337148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:08.362166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e895cee22648419a601f5015f55b0b', 'request_id': 'req-45487b3c-9632-4d43-a737-4872abe471c5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.370970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e895cee22648419a601f5015f55b0b', 'request_id': 'req-45487b3c-9632-4d43-a737-4872abe471c5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.377135 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e895cee22648419a601f5015f55b0b', 'request_id': 'req-45487b3c-9632-4d43-a737-4872abe471c5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.391563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] The token cache is being invalidate because project 45e895cee22648419a601f5015f55b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:08.392142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.393304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.395859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1246/2509] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:08 2022] DELETE /identity/v3/projects/45e895cee22648419a601f5015f55b0b => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:08.400134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d1d17-b4ba-4325-98be-de941a746928 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:08.410290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076d1d17-b4ba-4325-98be-de941a746928 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:08.469354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:08.470225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:08.470500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:08.470763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] PATH_INFO: `/v3/users/7f4672baa67d49968a20963cf5a31a58` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:08.472029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4672baa67d49968a20963cf5a31a58)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:08.473949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:08.494010 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:08.519841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4672baa67d49968a20963cf5a31a58'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.520494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4672baa67d49968a20963cf5a31a58'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.530245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4672baa67d49968a20963cf5a31a58'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.537411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4672baa67d49968a20963cf5a31a58'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.538051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1c6717dc-8c39-421e-80d7-b53719c975a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4672baa67d49968a20963cf5a31a58'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:08.556129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1264/2510] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:08 2022] DELETE /identity/v3/users/7f4672baa67d49968a20963cf5a31a58 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:08.858922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:08.862226 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:08.880298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45487b3c-9632-4d43-a737-4872abe471c5 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:08.944275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:08.945152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:08.945433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:08.945706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] PATH_INFO: `/v3/projects/2d5b13f8bfea43aa8dded73775d22850` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:08.946882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5b13f8bfea43aa8dded73775d22850)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:08.949164 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:08.997952 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5b13f8bfea43aa8dded73775d22850', 'request_id': 'req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:09.007166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5b13f8bfea43aa8dded73775d22850', 'request_id': 'req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:09.013217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5b13f8bfea43aa8dded73775d22850', 'request_id': 'req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:09.026239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] The token cache is being invalidate because project 2d5b13f8bfea43aa8dded73775d22850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:09.026573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:09.027270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e697a3a2-9f7b-436c-bab8-aee7fc4b5ad5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:09.028978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1247/2511] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:08 2022] DELETE /identity/v3/projects/2d5b13f8bfea43aa8dded73775d22850 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:09.034134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57dfb-388d-4f6a-966d-d9932a14b871 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.034636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57dfb-388d-4f6a-966d-d9932a14b871 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.034732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57dfb-388d-4f6a-966d-d9932a14b871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.054839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-75f57dfb-388d-4f6a-966d-d9932a14b871 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:09.056093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-75f57dfb-388d-4f6a-966d-d9932a14b871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:09.118799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1265/2512] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:09.126957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42133a56-9eef-4433-94b1-2c2f1b0f578c None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.127358 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42133a56-9eef-4433-94b1-2c2f1b0f578c None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.127733 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42133a56-9eef-4433-94b1-2c2f1b0f578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.146408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-42133a56-9eef-4433-94b1-2c2f1b0f578c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:09.147738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-42133a56-9eef-4433-94b1-2c2f1b0f578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:09.157769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1248/2513] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:09.161990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57dfb-388d-4f6a-966d-d9932a14b871 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.172042 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57dfb-388d-4f6a-966d-d9932a14b871 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.177152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.177818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.178103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.178387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.179122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:09.179431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.181065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.192900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1266/2514] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:09.197123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42133a56-9eef-4433-94b1-2c2f1b0f578c None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.207095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42133a56-9eef-4433-94b1-2c2f1b0f578c None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.212942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d669570-9801-4397-ab9a-fe2b234f534b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.213589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669570-9801-4397-ab9a-fe2b234f534b admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.213875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669570-9801-4397-ab9a-fe2b234f534b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.214149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d669570-9801-4397-ab9a-fe2b234f534b admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.214850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d669570-9801-4397-ab9a-fe2b234f534b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.216775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d669570-9801-4397-ab9a-fe2b234f534b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.245933 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1249/2515] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:09 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:09.250296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.260340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c79332-f08b-48ab-a2a6-0d059e3f5aeb admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.318278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82da3c-a293-4437-aaf9-5afe46b2ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.318944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82da3c-a293-4437-aaf9-5afe46b2ead5 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.319224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82da3c-a293-4437-aaf9-5afe46b2ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.319498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a82da3c-a293-4437-aaf9-5afe46b2ead5 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.320259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82da3c-a293-4437-aaf9-5afe46b2ead5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.322178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a82da3c-a293-4437-aaf9-5afe46b2ead5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.345255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1267/2516] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:09 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:09.349431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d669570-9801-4397-ab9a-fe2b234f534b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.360262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d669570-9801-4397-ab9a-fe2b234f534b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.365986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb1468-7074-428a-8d40-726fa9780c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.366755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1468-7074-428a-8d40-726fa9780c86 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.366937 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1468-7074-428a-8d40-726fa9780c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.367212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb1468-7074-428a-8d40-726fa9780c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.367977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1468-7074-428a-8d40-726fa9780c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.369580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacb1468-7074-428a-8d40-726fa9780c86 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.380904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1250/2517] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:09.384839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82da3c-a293-4437-aaf9-5afe46b2ead5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.395041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a82da3c-a293-4437-aaf9-5afe46b2ead5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.399815 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a409dd-51b1-47c6-a14c-e61ede76f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.400486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a409dd-51b1-47c6-a14c-e61ede76f117 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.400780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a409dd-51b1-47c6-a14c-e61ede76f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.401031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a409dd-51b1-47c6-a14c-e61ede76f117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.401765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a409dd-51b1-47c6-a14c-e61ede76f117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.403342 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a409dd-51b1-47c6-a14c-e61ede76f117 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.413625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1268/2518] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:50:09.417714 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb1468-7074-428a-8d40-726fa9780c86 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.422987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:09.429593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb1468-7074-428a-8d40-726fa9780c86 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.435764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77974df-0009-4c52-a761-095836d0fb4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.436666 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77974df-0009-4c52-a761-095836d0fb4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.436951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77974df-0009-4c52-a761-095836d0fb4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.437673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77974df-0009-4c52-a761-095836d0fb4a admin admin] PATH_INFO: `/v3/projects/ba664a36e1244e4e96ab32c6b8e00976/users/991372105cd94f5c804d330a2e8485f3/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.453235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77974df-0009-4c52-a761-095836d0fb4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba664a36e1244e4e96ab32c6b8e00976, user_id=991372105cd94f5c804d330a2e8485f3, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.455928 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77974df-0009-4c52-a761-095836d0fb4a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.470710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1251/2519] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:09 2022] PUT /identity/v3/projects/ba664a36e1244e4e96ab32c6b8e00976/users/991372105cd94f5c804d330a2e8485f3/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:09.481039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f21e-50cf-41e4-bb45-f51d79bd67dc None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.481998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f21e-50cf-41e4-bb45-f51d79bd67dc None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.482410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5244f21e-50cf-41e4-bb45-f51d79bd67dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.489002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:09.512234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-5244f21e-50cf-41e4-bb45-f51d79bd67dc None None] MFA Rules not processed for user `991372105cd94f5c804d330a2e8485f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:09.513438 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5244f21e-50cf-41e4-bb45-f51d79bd67dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:09.579328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1269/2520] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:09 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:09.584236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77974df-0009-4c52-a761-095836d0fb4a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.658743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77974df-0009-4c52-a761-095836d0fb4a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.663867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ac0b-db44-4350-82d3-e91807a6741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.664471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ac0b-db44-4350-82d3-e91807a6741c admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.664755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ac0b-db44-4350-82d3-e91807a6741c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.665033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ac0b-db44-4350-82d3-e91807a6741c admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.665760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0ac0b-db44-4350-82d3-e91807a6741c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.667702 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b0ac0b-db44-4350-82d3-e91807a6741c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.695808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1252/2521] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:09 2022] POST /identity/v3/projects => generated 409 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:09.701326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244f21e-50cf-41e4-bb45-f51d79bd67dc None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.713394 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5244f21e-50cf-41e4-bb45-f51d79bd67dc None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.773651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c623a-6b28-44b9-92c5-540a1ce3fda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.774322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c623a-6b28-44b9-92c5-540a1ce3fda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.774601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c623a-6b28-44b9-92c5-540a1ce3fda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.774883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c623a-6b28-44b9-92c5-540a1ce3fda1 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.775571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c623a-6b28-44b9-92c5-540a1ce3fda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.777539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c623a-6b28-44b9-92c5-540a1ce3fda1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.805331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1270/2522] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:09 2022] POST /identity/v3/users => generated 311 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:09.809994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ac0b-db44-4350-82d3-e91807a6741c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.820942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ac0b-db44-4350-82d3-e91807a6741c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.826775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f8e19-e067-42c0-96ea-29bfdbfba582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.827446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f8e19-e067-42c0-96ea-29bfdbfba582 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.827767 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f8e19-e067-42c0-96ea-29bfdbfba582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.828040 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f8e19-e067-42c0-96ea-29bfdbfba582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.828808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f8e19-e067-42c0-96ea-29bfdbfba582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.830411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f8e19-e067-42c0-96ea-29bfdbfba582 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.843014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1253/2523] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:09.847258 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c623a-6b28-44b9-92c5-540a1ce3fda1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.857762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c623a-6b28-44b9-92c5-540a1ce3fda1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.863568 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61c621-0fad-45c5-9be2-18ac9fb53c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.864588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61c621-0fad-45c5-9be2-18ac9fb53c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.864874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61c621-0fad-45c5-9be2-18ac9fb53c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.865123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61c621-0fad-45c5-9be2-18ac9fb53c79 admin admin] PATH_INFO: `/v3/projects/7abc232321874ca5b2ab1d64fff21e21/users/d54f5b24690745229bb6f65d08e21e93/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.880990 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61c621-0fad-45c5-9be2-18ac9fb53c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abc232321874ca5b2ab1d64fff21e21, user_id=d54f5b24690745229bb6f65d08e21e93, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.883681 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61c621-0fad-45c5-9be2-18ac9fb53c79 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.898262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1271/2524] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:09 2022] PUT /identity/v3/projects/7abc232321874ca5b2ab1d64fff21e21/users/d54f5b24690745229bb6f65d08e21e93/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:09.902210 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f8e19-e067-42c0-96ea-29bfdbfba582 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:09.912311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f8e19-e067-42c0-96ea-29bfdbfba582 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:09.969319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdbc4e6-dcc4-40c3-adaf-0a96ae6f7f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:09.969883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc4e6-dcc4-40c3-adaf-0a96ae6f7f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:09.970170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc4e6-dcc4-40c3-adaf-0a96ae6f7f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:09.970444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbc4e6-dcc4-40c3-adaf-0a96ae6f7f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:09.971177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbc4e6-dcc4-40c3-adaf-0a96ae6f7f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:09.972839 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdbc4e6-dcc4-40c3-adaf-0a96ae6f7f22 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:09.984459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1254/2525] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:09.989949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61c621-0fad-45c5-9be2-18ac9fb53c79 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:10.006202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61c621-0fad-45c5-9be2-18ac9fb53c79 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:10.012863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:10.013763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:10.014040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:10.014314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] PATH_INFO: `/v3/projects/7abc232321874ca5b2ab1d64fff21e21/users/d54f5b24690745229bb6f65d08e21e93/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:10.016643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abc232321874ca5b2ab1d64fff21e21, user_id=d54f5b24690745229bb6f65d08e21e93, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:10.019366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:10.030144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1272/2526] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:09 2022] PUT /identity/v3/projects/7abc232321874ca5b2ab1d64fff21e21/users/d54f5b24690745229bb6f65d08e21e93/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:10.049449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cbe8-3de2-4156-be82-c6ff60208ef2 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:10.049697 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cbe8-3de2-4156-be82-c6ff60208ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:10.050003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cbe8-3de2-4156-be82-c6ff60208ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:10.082575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1547cbe8-3de2-4156-be82-c6ff60208ef2 None None] MFA Rules not processed for user `d54f5b24690745229bb6f65d08e21e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:10.083890 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1547cbe8-3de2-4156-be82-c6ff60208ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:10.123626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:10.157496 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1255/2527] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:10 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:10.168751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:10.170763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:10.218987 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:10.230862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834900bd-bc89-48fc-a9ae-33126bf39135 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:10.234913 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:10.235575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:10.235884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:10.236156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:10.245431 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:10.246872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:10.256718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1273/2528] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:10 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:50:10.405738 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547cbe8-3de2-4156-be82-c6ff60208ef2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:10.415621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547cbe8-3de2-4156-be82-c6ff60208ef2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:10.419259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9253b-9998-4816-81fc-cb35262bb117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:10.419947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9253b-9998-4816-81fc-cb35262bb117 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:10.420232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9253b-9998-4816-81fc-cb35262bb117 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:10.420508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9253b-9998-4816-81fc-cb35262bb117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:10.478074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9253b-9998-4816-81fc-cb35262bb117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:10.479508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9253b-9998-4816-81fc-cb35262bb117 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:10.490208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1256/2529] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:10 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:14.041174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:14.042726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:14.105797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac132cbc-ebc6-44ec-9f00-34089d321660 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:14.110359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02852ae3-98f6-40ab-8aee-8bda6286ecbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:14.111013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02852ae3-98f6-40ab-8aee-8bda6286ecbf service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:14.111290 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02852ae3-98f6-40ab-8aee-8bda6286ecbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:14.111569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02852ae3-98f6-40ab-8aee-8bda6286ecbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:14.113402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-02852ae3-98f6-40ab-8aee-8bda6286ecbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:14.177321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02852ae3-98f6-40ab-8aee-8bda6286ecbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:14.178711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02852ae3-98f6-40ab-8aee-8bda6286ecbf service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:14.188621 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1274/2530] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:14 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:15.795760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9253b-9998-4816-81fc-cb35262bb117 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:15.870589 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9253b-9998-4816-81fc-cb35262bb117 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:15.875296 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:15.876289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:15.876571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:15.876850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] PATH_INFO: `/v3/users/991372105cd94f5c804d330a2e8485f3` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:15.878139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=991372105cd94f5c804d330a2e8485f3)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:15.880114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:15.933028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '991372105cd94f5c804d330a2e8485f3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:15.942238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '991372105cd94f5c804d330a2e8485f3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:15.943080 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '991372105cd94f5c804d330a2e8485f3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:15.951310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '991372105cd94f5c804d330a2e8485f3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:15.959755 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:15.964600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '991372105cd94f5c804d330a2e8485f3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:15.971709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1257/2531] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:15 2022] DELETE /identity/v3/users/991372105cd94f5c804d330a2e8485f3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:15.976500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc7366-e165-4a0e-a026-ba8356f6fa90 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:15.977000 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc7366-e165-4a0e-a026-ba8356f6fa90 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:15.977202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc7366-e165-4a0e-a026-ba8356f6fa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:15.995309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8bdc7366-e165-4a0e-a026-ba8356f6fa90 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:15.996648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8bdc7366-e165-4a0e-a026-ba8356f6fa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:16.069720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1275/2532] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:16.079864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:16.081321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:16.146586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eaff56-c844-44fa-8214-d9acf871b9d7 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:16.150415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478b9b-e6e9-4518-9d36-52294b630298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:16.151070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478b9b-e6e9-4518-9d36-52294b630298 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:16.151326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478b9b-e6e9-4518-9d36-52294b630298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:16.151647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478b9b-e6e9-4518-9d36-52294b630298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:16.162444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478b9b-e6e9-4518-9d36-52294b630298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:16.164484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478b9b-e6e9-4518-9d36-52294b630298 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:16.174747 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1258/2533] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:50:16.629508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc7366-e165-4a0e-a026-ba8356f6fa90 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:16.630953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8bdc7366-e165-4a0e-a026-ba8356f6fa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:16.643295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc7366-e165-4a0e-a026-ba8356f6fa90 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:16.648124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:16.649007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:16.649292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:16.649566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] PATH_INFO: `/v3/projects/ba664a36e1244e4e96ab32c6b8e00976` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:16.650809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba664a36e1244e4e96ab32c6b8e00976)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:16.652964 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:16.694256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:16.711729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba664a36e1244e4e96ab32c6b8e00976', 'request_id': 'req-f0b42979-5522-4891-9b84-5fec34e81b4f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.719845 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba664a36e1244e4e96ab32c6b8e00976', 'request_id': 'req-f0b42979-5522-4891-9b84-5fec34e81b4f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.730030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba664a36e1244e4e96ab32c6b8e00976', 'request_id': 'req-f0b42979-5522-4891-9b84-5fec34e81b4f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.749502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] The token cache is being invalidate because project ba664a36e1244e4e96ab32c6b8e00976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:16.750850 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.751761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.754508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1276/2534] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:16 2022] DELETE /identity/v3/projects/ba664a36e1244e4e96ab32c6b8e00976 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:16.758404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478b9b-e6e9-4518-9d36-52294b630298 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:16.768205 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478b9b-e6e9-4518-9d36-52294b630298 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:16.827136 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:16.828090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:16.828371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:16.828648 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] PATH_INFO: `/v3/users/d54f5b24690745229bb6f65d08e21e93` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:16.829840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54f5b24690745229bb6f65d08e21e93)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:16.831810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:16.879587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54f5b24690745229bb6f65d08e21e93'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.890093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54f5b24690745229bb6f65d08e21e93'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.891050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54f5b24690745229bb6f65d08e21e93'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.898572 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54f5b24690745229bb6f65d08e21e93'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.911842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-240868e1-1d5e-4aa5-b970-5144a4c66cce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54f5b24690745229bb6f65d08e21e93'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:16.919786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1259/2535] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:16 2022] DELETE /identity/v3/users/d54f5b24690745229bb6f65d08e21e93 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:17.219213 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:17.220784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:17.242440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b42979-5522-4891-9b84-5fec34e81b4f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:17.315222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:17.316201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.316476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.316744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] PATH_INFO: `/v3/projects/7abc232321874ca5b2ab1d64fff21e21` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.317940 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abc232321874ca5b2ab1d64fff21e21)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:17.319917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:17.366427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abc232321874ca5b2ab1d64fff21e21', 'request_id': 'req-7cb25aa3-b58a-4f8c-9386-79e5a538896e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:17.372936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abc232321874ca5b2ab1d64fff21e21', 'request_id': 'req-7cb25aa3-b58a-4f8c-9386-79e5a538896e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:17.380859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abc232321874ca5b2ab1d64fff21e21', 'request_id': 'req-7cb25aa3-b58a-4f8c-9386-79e5a538896e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:17.391155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] The token cache is being invalidate because project 7abc232321874ca5b2ab1d64fff21e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:17.391445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:17.392112 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-7cb25aa3-b58a-4f8c-9386-79e5a538896e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:17.396893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1277/2536] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:17 2022] DELETE /identity/v3/projects/7abc232321874ca5b2ab1d64fff21e21 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:17.398961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1afbf-8081-4241-8f1f-522cd2530ea3 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.399327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1afbf-8081-4241-8f1f-522cd2530ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.399730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1afbf-8081-4241-8f1f-522cd2530ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.420545 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-99e1afbf-8081-4241-8f1f-522cd2530ea3 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:17.421888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-99e1afbf-8081-4241-8f1f-522cd2530ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:17.431310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:17.483838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1260/2537] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:17.492524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cd854-5e29-4619-bf33-317df46511a1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.492810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cd854-5e29-4619-bf33-317df46511a1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.493152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3cd854-5e29-4619-bf33-317df46511a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.516924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-bf3cd854-5e29-4619-bf33-317df46511a1 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:17.518140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bf3cd854-5e29-4619-bf33-317df46511a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:17.527322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1278/2538] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:17.531624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1afbf-8081-4241-8f1f-522cd2530ea3 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:17.542674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1afbf-8081-4241-8f1f-522cd2530ea3 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:17.547639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:17.548282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.548580 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.548838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.549570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:17.549868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:17.551469 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:17.563931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1261/2539] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:17.568567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cd854-5e29-4619-bf33-317df46511a1 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:17.578686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3cd854-5e29-4619-bf33-317df46511a1 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:17.583907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bb82-5a95-49ad-93a3-3da134434e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:17.584581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bb82-5a95-49ad-93a3-3da134434e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.584864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bb82-5a95-49ad-93a3-3da134434e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.585137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bb82-5a95-49ad-93a3-3da134434e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.585833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343bb82-5a95-49ad-93a3-3da134434e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:17.587803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343bb82-5a95-49ad-93a3-3da134434e3f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:17.618701 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1279/2540] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:17 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:17.619889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:17.630324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f116a8-7b8a-425b-86ab-4e2dcb78d576 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:17.698072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b92c6-26b0-4ff7-9bc0-bb7c889976d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:17.698744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b92c6-26b0-4ff7-9bc0-bb7c889976d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.699342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b92c6-26b0-4ff7-9bc0-bb7c889976d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.699632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b92c6-26b0-4ff7-9bc0-bb7c889976d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.700331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b92c6-26b0-4ff7-9bc0-bb7c889976d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:17.702288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b92c6-26b0-4ff7-9bc0-bb7c889976d2 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:17.725317 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1262/2541] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:17 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:17.727218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bb82-5a95-49ad-93a3-3da134434e3f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:17.738031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bb82-5a95-49ad-93a3-3da134434e3f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:17.743564 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03333183-2ee4-4059-8a7f-9f6bb0c233c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:17.744275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03333183-2ee4-4059-8a7f-9f6bb0c233c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.744558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03333183-2ee4-4059-8a7f-9f6bb0c233c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.744832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03333183-2ee4-4059-8a7f-9f6bb0c233c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.745576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03333183-2ee4-4059-8a7f-9f6bb0c233c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:17.747185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03333183-2ee4-4059-8a7f-9f6bb0c233c9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:17.880797 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1280/2542] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:17.885060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b92c6-26b0-4ff7-9bc0-bb7c889976d2 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:17.895829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b92c6-26b0-4ff7-9bc0-bb7c889976d2 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:17.901973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e7e1e-4826-41e9-91c0-727196688813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:17.902651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7e1e-4826-41e9-91c0-727196688813 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.902957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7e1e-4826-41e9-91c0-727196688813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.903345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e7e1e-4826-41e9-91c0-727196688813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.904123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e7e1e-4826-41e9-91c0-727196688813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:17.905727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e7e1e-4826-41e9-91c0-727196688813 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:17.916870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1263/2543] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:17.921058 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03333183-2ee4-4059-8a7f-9f6bb0c233c9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:17.931558 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03333183-2ee4-4059-8a7f-9f6bb0c233c9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:17.936855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc656f-3995-4901-80a5-86629a5f9b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:17.937739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc656f-3995-4901-80a5-86629a5f9b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.938022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc656f-3995-4901-80a5-86629a5f9b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.938291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc656f-3995-4901-80a5-86629a5f9b94 admin admin] PATH_INFO: `/v3/projects/fdbde53feffd41cb9cf7305fec1433f9/users/693071c6abb0495c84e6f87805bf04e0/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:17.946712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:17.954853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc656f-3995-4901-80a5-86629a5f9b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbde53feffd41cb9cf7305fec1433f9, user_id=693071c6abb0495c84e6f87805bf04e0, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:17.958046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc656f-3995-4901-80a5-86629a5f9b94 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:17.972282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1281/2544] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:17 2022] PUT /identity/v3/projects/fdbde53feffd41cb9cf7305fec1433f9/users/693071c6abb0495c84e6f87805bf04e0/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:17.982735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec66ee-266b-482d-b212-79168c1b6b9f None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:17.983050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec66ee-266b-482d-b212-79168c1b6b9f None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:17.983328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec66ee-266b-482d-b212-79168c1b6b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.011502 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7fec66ee-266b-482d-b212-79168c1b6b9f None None] MFA Rules not processed for user `693071c6abb0495c84e6f87805bf04e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:18.012739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7fec66ee-266b-482d-b212-79168c1b6b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:18.078475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1264/2545] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:18.083013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc656f-3995-4901-80a5-86629a5f9b94 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:18.152807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc656f-3995-4901-80a5-86629a5f9b94 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:18.158694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630013-6504-4e39-bd58-e4e2cbb7393e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:18.159371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630013-6504-4e39-bd58-e4e2cbb7393e admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:18.159718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630013-6504-4e39-bd58-e4e2cbb7393e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:18.159991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32630013-6504-4e39-bd58-e4e2cbb7393e admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.160689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32630013-6504-4e39-bd58-e4e2cbb7393e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:18.162589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32630013-6504-4e39-bd58-e4e2cbb7393e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:18.200197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1282/2546] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:18 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:18.204814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec66ee-266b-482d-b212-79168c1b6b9f None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:18.216265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec66ee-266b-482d-b212-79168c1b6b9f None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:18.221213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:18.275935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a2a2c-f319-4ad8-8df3-372630166a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:18.276530 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a2a2c-f319-4ad8-8df3-372630166a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:18.276818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a2a2c-f319-4ad8-8df3-372630166a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:18.277089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a2a2c-f319-4ad8-8df3-372630166a0f admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.277773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a2a2c-f319-4ad8-8df3-372630166a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:18.279742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a2a2c-f319-4ad8-8df3-372630166a0f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:18.301701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1265/2547] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:18 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:18.305696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630013-6504-4e39-bd58-e4e2cbb7393e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:18.315874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32630013-6504-4e39-bd58-e4e2cbb7393e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:18.321006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc08691-e216-48e0-b1c0-095eab7e1cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:18.321661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc08691-e216-48e0-b1c0-095eab7e1cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:18.321935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc08691-e216-48e0-b1c0-095eab7e1cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:18.322205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc08691-e216-48e0-b1c0-095eab7e1cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.322928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc08691-e216-48e0-b1c0-095eab7e1cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:18.324864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc08691-e216-48e0-b1c0-095eab7e1cb2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:18.335137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1283/2548] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:50:18.339172 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a2a2c-f319-4ad8-8df3-372630166a0f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:18.350413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a2a2c-f319-4ad8-8df3-372630166a0f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:18.355429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521e2e4-f486-4023-8528-ec6c4b9fa055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:18.356351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e2e4-f486-4023-8528-ec6c4b9fa055 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:18.356632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e2e4-f486-4023-8528-ec6c4b9fa055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:18.356905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521e2e4-f486-4023-8528-ec6c4b9fa055 admin admin] PATH_INFO: `/v3/projects/ca6e18742f1b4d379a4dcd6301e96a90/users/421d9cac4b0546f3801d03d0b5d86f1b/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.372225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521e2e4-f486-4023-8528-ec6c4b9fa055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6e18742f1b4d379a4dcd6301e96a90, user_id=421d9cac4b0546f3801d03d0b5d86f1b, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:18.374860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521e2e4-f486-4023-8528-ec6c4b9fa055 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:18.392154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1266/2549] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:18 2022] PUT /identity/v3/projects/ca6e18742f1b4d379a4dcd6301e96a90/users/421d9cac4b0546f3801d03d0b5d86f1b/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:18.396280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc08691-e216-48e0-b1c0-095eab7e1cb2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:18.406924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc08691-e216-48e0-b1c0-095eab7e1cb2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:18.467736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f554c15-408c-4497-a293-2c3377f66063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:18.468377 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f554c15-408c-4497-a293-2c3377f66063 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:18.468705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f554c15-408c-4497-a293-2c3377f66063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:18.468979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f554c15-408c-4497-a293-2c3377f66063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.469726 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f554c15-408c-4497-a293-2c3377f66063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:18.471301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f554c15-408c-4497-a293-2c3377f66063 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:18.481366 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1284/2550] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:18.485916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521e2e4-f486-4023-8528-ec6c4b9fa055 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:18.497060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521e2e4-f486-4023-8528-ec6c4b9fa055 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:18.504631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:18.506087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:18.506540 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:18.506978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] PATH_INFO: `/v3/projects/ca6e18742f1b4d379a4dcd6301e96a90/users/421d9cac4b0546f3801d03d0b5d86f1b/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.510470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6e18742f1b4d379a4dcd6301e96a90, user_id=421d9cac4b0546f3801d03d0b5d86f1b, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:18.514770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:18.526266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1267/2551] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:18 2022] PUT /identity/v3/projects/ca6e18742f1b4d379a4dcd6301e96a90/users/421d9cac4b0546f3801d03d0b5d86f1b/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:18.537584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8d4ca-e3d4-4b48-84a2-265294ccd3ac None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:18.537875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8d4ca-e3d4-4b48-84a2-265294ccd3ac None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:18.538152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8d4ca-e3d4-4b48-84a2-265294ccd3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.565517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-93f8d4ca-e3d4-4b48-84a2-265294ccd3ac None None] MFA Rules not processed for user `421d9cac4b0546f3801d03d0b5d86f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:18.567551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-93f8d4ca-e3d4-4b48-84a2-265294ccd3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:18.620402 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:18.657295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1285/2552] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:18.668613 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:18.670613 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:18.733027 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e10650-4202-4f00-99af-a3cc901df285 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:18.737138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15bf38-6a31-47d9-98fe-221579a9a42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:18.737788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15bf38-6a31-47d9-98fe-221579a9a42c service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:18.738072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15bf38-6a31-47d9-98fe-221579a9a42c service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:18.738337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15bf38-6a31-47d9-98fe-221579a9a42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:18.748508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15bf38-6a31-47d9-98fe-221579a9a42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:18.749939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15bf38-6a31-47d9-98fe-221579a9a42c service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:18.759629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1268/2553] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:19.382124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8d4ca-e3d4-4b48-84a2-265294ccd3ac None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:19.453162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8d4ca-e3d4-4b48-84a2-265294ccd3ac None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:19.459129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:19.460070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:19.460350 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:19.460626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] PATH_INFO: `/v3/users/693071c6abb0495c84e6f87805bf04e0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:19.462057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=693071c6abb0495c84e6f87805bf04e0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:19.464001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:19.513708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '693071c6abb0495c84e6f87805bf04e0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:19.514355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '693071c6abb0495c84e6f87805bf04e0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:19.522624 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '693071c6abb0495c84e6f87805bf04e0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:19.529451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '693071c6abb0495c84e6f87805bf04e0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:19.530168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '693071c6abb0495c84e6f87805bf04e0'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:19.547437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1286/2554] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:19 2022] DELETE /identity/v3/users/693071c6abb0495c84e6f87805bf04e0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:19.552285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ef8ad-a8ae-42b4-9525-0558ee359756 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:19.552792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ef8ad-a8ae-42b4-9525-0558ee359756 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:19.552891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8ef8ad-a8ae-42b4-9525-0558ee359756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:19.570415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-0f8ef8ad-a8ae-42b4-9525-0558ee359756 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:19.571670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0f8ef8ad-a8ae-42b4-9525-0558ee359756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:19.638153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1269/2555] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:19.648605 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:19.650131 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:19.713534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c81395-b57c-4c08-8918-25b81d58f2b2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:19.717705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ed2c-c3eb-427a-8e5d-284ff6db8857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:19.718482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ed2c-c3eb-427a-8e5d-284ff6db8857 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:19.718880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ed2c-c3eb-427a-8e5d-284ff6db8857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:19.719171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19ed2c-c3eb-427a-8e5d-284ff6db8857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:19.729555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19ed2c-c3eb-427a-8e5d-284ff6db8857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:19.730997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19ed2c-c3eb-427a-8e5d-284ff6db8857 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:19.741246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1287/2556] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:20.020428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ef8ad-a8ae-42b4-9525-0558ee359756 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:20.022794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-0f8ef8ad-a8ae-42b4-9525-0558ee359756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:20.031982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:20.035964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8ef8ad-a8ae-42b4-9525-0558ee359756 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:20.041748 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:20.042744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:20.043083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:20.043413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] PATH_INFO: `/v3/projects/fdbde53feffd41cb9cf7305fec1433f9` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:20.044741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbde53feffd41cb9cf7305fec1433f9)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:20.046765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:20.096174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbde53feffd41cb9cf7305fec1433f9', 'request_id': 'req-4d1a7159-ef16-4870-a13b-3255e83e04ab'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.105006 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbde53feffd41cb9cf7305fec1433f9', 'request_id': 'req-4d1a7159-ef16-4870-a13b-3255e83e04ab'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.110687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbde53feffd41cb9cf7305fec1433f9', 'request_id': 'req-4d1a7159-ef16-4870-a13b-3255e83e04ab'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.121477 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] The token cache is being invalidate because project fdbde53feffd41cb9cf7305fec1433f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:20.121762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.122374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.123954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1270/2557] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:20 2022] DELETE /identity/v3/projects/fdbde53feffd41cb9cf7305fec1433f9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:20.128313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ed2c-c3eb-427a-8e5d-284ff6db8857 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:20.135369 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:20.139574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19ed2c-c3eb-427a-8e5d-284ff6db8857 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:20.201499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:20.202380 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:20.202642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:20.202936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] PATH_INFO: `/v3/users/421d9cac4b0546f3801d03d0b5d86f1b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:20.204287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] RBAC: Authorizing `identity:delete_user(user_id=421d9cac4b0546f3801d03d0b5d86f1b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:20.206265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:20.256853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '421d9cac4b0546f3801d03d0b5d86f1b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.257570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '421d9cac4b0546f3801d03d0b5d86f1b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.267524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '421d9cac4b0546f3801d03d0b5d86f1b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.277747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '421d9cac4b0546f3801d03d0b5d86f1b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.278477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-21259d71-cf29-4a69-ac29-b6e13661938f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '421d9cac4b0546f3801d03d0b5d86f1b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.295196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1288/2558] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:20 2022] DELETE /identity/v3/users/421d9cac4b0546f3801d03d0b5d86f1b => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:20.576240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:20.577868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:20.591575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a7159-ef16-4870-a13b-3255e83e04ab admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:20.652314 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:20.653111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:20.653402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:20.653722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] PATH_INFO: `/v3/projects/ca6e18742f1b4d379a4dcd6301e96a90` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:20.654832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6e18742f1b4d379a4dcd6301e96a90)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:20.656917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:20.704392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6e18742f1b4d379a4dcd6301e96a90', 'request_id': 'req-427dc672-9407-4204-9a77-7244ed614eeb'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.714151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6e18742f1b4d379a4dcd6301e96a90', 'request_id': 'req-427dc672-9407-4204-9a77-7244ed614eeb'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.719995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6e18742f1b4d379a4dcd6301e96a90', 'request_id': 'req-427dc672-9407-4204-9a77-7244ed614eeb'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.731037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] The token cache is being invalidate because project ca6e18742f1b4d379a4dcd6301e96a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:20.731319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.731969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-427dc672-9407-4204-9a77-7244ed614eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:20.733518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1271/2559] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:20 2022] DELETE /identity/v3/projects/ca6e18742f1b4d379a4dcd6301e96a90 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:20.738759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8869c-d411-4df2-8b45-9a62ea84fb11 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:20.739270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8869c-d411-4df2-8b45-9a62ea84fb11 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:20.739368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8869c-d411-4df2-8b45-9a62ea84fb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:20.757911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-63f8869c-d411-4df2-8b45-9a62ea84fb11 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:20.759121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-63f8869c-d411-4df2-8b45-9a62ea84fb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:20.823967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1289/2560] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:20.832485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2c8e-a6f5-412a-b225-bd5464ffbbf6 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:20.832759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2c8e-a6f5-412a-b225-bd5464ffbbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:20.833046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a2c8e-a6f5-412a-b225-bd5464ffbbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:20.851965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-c66a2c8e-a6f5-412a-b225-bd5464ffbbf6 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:20.853175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c66a2c8e-a6f5-412a-b225-bd5464ffbbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:20.861931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1272/2561] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:20.866177 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8869c-d411-4df2-8b45-9a62ea84fb11 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:20.875831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8869c-d411-4df2-8b45-9a62ea84fb11 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:20.880554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:20.881207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:20.881486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:20.881757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:20.882543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:20.882851 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:20.884488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:20.896311 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1290/2562] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:20.900727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a2c8e-a6f5-412a-b225-bd5464ffbbf6 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:20.910093 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a2c8e-a6f5-412a-b225-bd5464ffbbf6 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:20.915025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734dc52-2c62-40ff-ba2f-8cddf604590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:20.915694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dc52-2c62-40ff-ba2f-8cddf604590e admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:20.915971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dc52-2c62-40ff-ba2f-8cddf604590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:20.916242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734dc52-2c62-40ff-ba2f-8cddf604590e admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:20.916925 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734dc52-2c62-40ff-ba2f-8cddf604590e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:20.918813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734dc52-2c62-40ff-ba2f-8cddf604590e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:20.927175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:20.947911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1273/2563] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:20 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:20.953962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:20.964153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed1076-0de2-4727-95e6-df44fa55e629 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:20.972488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:21.024843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e03b7-0022-4166-9d2b-3d22e9b6158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:21.025509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e03b7-0022-4166-9d2b-3d22e9b6158b admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.025794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e03b7-0022-4166-9d2b-3d22e9b6158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.026079 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e03b7-0022-4166-9d2b-3d22e9b6158b admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.026747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e03b7-0022-4166-9d2b-3d22e9b6158b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:21.028711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e03b7-0022-4166-9d2b-3d22e9b6158b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:21.051336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1291/2564] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:20 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:21.055719 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734dc52-2c62-40ff-ba2f-8cddf604590e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:21.066564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734dc52-2c62-40ff-ba2f-8cddf604590e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:21.072142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd28a53-6f07-465c-a002-ed36dc193989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:21.072846 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28a53-6f07-465c-a002-ed36dc193989 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.073126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28a53-6f07-465c-a002-ed36dc193989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.073398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28a53-6f07-465c-a002-ed36dc193989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.074505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd28a53-6f07-465c-a002-ed36dc193989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:21.076146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd28a53-6f07-465c-a002-ed36dc193989 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:21.086646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1274/2565] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:21.090672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e03b7-0022-4166-9d2b-3d22e9b6158b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:21.101189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e03b7-0022-4166-9d2b-3d22e9b6158b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:21.107212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d85ce-7a6a-4869-93e6-cc71517c76bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:21.107928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d85ce-7a6a-4869-93e6-cc71517c76bf admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.108212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d85ce-7a6a-4869-93e6-cc71517c76bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.108488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d85ce-7a6a-4869-93e6-cc71517c76bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.109223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d85ce-7a6a-4869-93e6-cc71517c76bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:21.110881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d85ce-7a6a-4869-93e6-cc71517c76bf admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:21.121595 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1292/2566] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:21.125964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd28a53-6f07-465c-a002-ed36dc193989 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:21.136111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd28a53-6f07-465c-a002-ed36dc193989 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:21.141104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:21.141994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.142278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.142555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] PATH_INFO: `/v3/projects/29cb217d71c34469bbcd150c4765dc07/users/c01e6a0a29b841bd9d61332612b0b2d6/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.157344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29cb217d71c34469bbcd150c4765dc07, user_id=c01e6a0a29b841bd9d61332612b0b2d6, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:21.160023 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:21.175628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1275/2567] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:21 2022] PUT /identity/v3/projects/29cb217d71c34469bbcd150c4765dc07/users/c01e6a0a29b841bd9d61332612b0b2d6/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:21.186852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764b8e-1668-4408-a5ec-0158abd9c810 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.187138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764b8e-1668-4408-a5ec-0158abd9c810 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.187411 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f764b8e-1668-4408-a5ec-0158abd9c810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.216152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7f764b8e-1668-4408-a5ec-0158abd9c810 None None] MFA Rules not processed for user `c01e6a0a29b841bd9d61332612b0b2d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:21.217407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7f764b8e-1668-4408-a5ec-0158abd9c810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:21.284099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1293/2568] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:21.296981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:21.298918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:21.385725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3198f8-eaaa-4703-807e-468463ac3511 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:21.392099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cc156-06e2-4a27-86f1-70dc54d61c3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:21.392818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc156-06e2-4a27-86f1-70dc54d61c3e service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.393128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc156-06e2-4a27-86f1-70dc54d61c3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.393410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cc156-06e2-4a27-86f1-70dc54d61c3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.402395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cc156-06e2-4a27-86f1-70dc54d61c3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:21.403891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cc156-06e2-4a27-86f1-70dc54d61c3e service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:21.412911 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1276/2569] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:21.437084 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764b8e-1668-4408-a5ec-0158abd9c810 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:21.501725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f764b8e-1668-4408-a5ec-0158abd9c810 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:21.506658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:21.507538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.507849 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.508119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] PATH_INFO: `/v3/users/c01e6a0a29b841bd9d61332612b0b2d6` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.509359 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01e6a0a29b841bd9d61332612b0b2d6)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:21.511282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:21.532735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:21.560065 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01e6a0a29b841bd9d61332612b0b2d6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:21.560757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01e6a0a29b841bd9d61332612b0b2d6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:21.569252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01e6a0a29b841bd9d61332612b0b2d6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:21.576852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01e6a0a29b841bd9d61332612b0b2d6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:21.577508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01e6a0a29b841bd9d61332612b0b2d6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:21.594173 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1294/2570] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:21 2022] DELETE /identity/v3/users/c01e6a0a29b841bd9d61332612b0b2d6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:21.598772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9177f-50c9-41cd-b217-7f018642d3d2 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.599349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9177f-50c9-41cd-b217-7f018642d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.599349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9177f-50c9-41cd-b217-7f018642d3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.618050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-38a9177f-50c9-41cd-b217-7f018642d3d2 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:21.619266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-38a9177f-50c9-41cd-b217-7f018642d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:21.696452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1277/2571] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:21.706694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:21.708387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:21.771259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf813502-a699-4232-ae6d-4bf1529a81c0 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:21.775619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46af467-3c59-47b6-a8f7-1c7d366e8378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:21.776307 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46af467-3c59-47b6-a8f7-1c7d366e8378 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:21.776588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46af467-3c59-47b6-a8f7-1c7d366e8378 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:21.776858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46af467-3c59-47b6-a8f7-1c7d366e8378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:21.786802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46af467-3c59-47b6-a8f7-1c7d366e8378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:21.788277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46af467-3c59-47b6-a8f7-1c7d366e8378 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:21.797946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1295/2572] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:22.103219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9177f-50c9-41cd-b217-7f018642d3d2 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.104887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-38a9177f-50c9-41cd-b217-7f018642d3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:22.117984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9177f-50c9-41cd-b217-7f018642d3d2 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.122964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.123982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.124332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.124671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] PATH_INFO: `/v3/projects/29cb217d71c34469bbcd150c4765dc07` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.125950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29cb217d71c34469bbcd150c4765dc07)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.127986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.183775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29cb217d71c34469bbcd150c4765dc07', 'request_id': 'req-4e7eb77b-cf08-4409-96a6-d27b391b9590'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:22.187212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:22.196415 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29cb217d71c34469bbcd150c4765dc07', 'request_id': 'req-4e7eb77b-cf08-4409-96a6-d27b391b9590'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:22.210056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29cb217d71c34469bbcd150c4765dc07', 'request_id': 'req-4e7eb77b-cf08-4409-96a6-d27b391b9590'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:22.223153 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] The token cache is being invalidate because project 29cb217d71c34469bbcd150c4765dc07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:22.223465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:22.224374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4e7eb77b-cf08-4409-96a6-d27b391b9590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:22.226052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1278/2573] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:22 2022] DELETE /identity/v3/projects/29cb217d71c34469bbcd150c4765dc07 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:22.231121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e93ce-3755-45ca-8d42-39a1940c7553 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.231419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e93ce-3755-45ca-8d42-39a1940c7553 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.231743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841e93ce-3755-45ca-8d42-39a1940c7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.250337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-841e93ce-3755-45ca-8d42-39a1940c7553 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:22.251614 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-841e93ce-3755-45ca-8d42-39a1940c7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:22.311970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1296/2574] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:22.322779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6c273-a50c-45c5-adb1-c25059aa058b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.323117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6c273-a50c-45c5-adb1-c25059aa058b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.323395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6c273-a50c-45c5-adb1-c25059aa058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.344699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-dce6c273-a50c-45c5-adb1-c25059aa058b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:22.345929 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-dce6c273-a50c-45c5-adb1-c25059aa058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:22.355324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1279/2575] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:22.359890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e93ce-3755-45ca-8d42-39a1940c7553 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.370279 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841e93ce-3755-45ca-8d42-39a1940c7553 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.376322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.376997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.377280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.377553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.378331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:22.378637 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.380281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.392493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1297/2576] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:22.396845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6c273-a50c-45c5-adb1-c25059aa058b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.406603 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6c273-a50c-45c5-adb1-c25059aa058b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.412010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c62e15-3ae0-416d-95c3-38ec8db05e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.412665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c62e15-3ae0-416d-95c3-38ec8db05e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.412944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c62e15-3ae0-416d-95c3-38ec8db05e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.413214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c62e15-3ae0-416d-95c3-38ec8db05e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.413909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c62e15-3ae0-416d-95c3-38ec8db05e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.415824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c62e15-3ae0-416d-95c3-38ec8db05e7e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.444655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1280/2577] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:22 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:22.448863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.459452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3479cd-a7a4-416e-9a39-4c9e50133e74 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.486932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:22.519901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d3356-0432-4837-a446-0feef7b2473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.520608 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3356-0432-4837-a446-0feef7b2473a admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.520886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3356-0432-4837-a446-0feef7b2473a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.521159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d3356-0432-4837-a446-0feef7b2473a admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.521853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d3356-0432-4837-a446-0feef7b2473a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.523831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d3356-0432-4837-a446-0feef7b2473a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.544489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1298/2578] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:22 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:22.549319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c62e15-3ae0-416d-95c3-38ec8db05e7e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.560299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c62e15-3ae0-416d-95c3-38ec8db05e7e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.565945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2148d-f304-40a9-b989-9f8aed993c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.566605 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2148d-f304-40a9-b989-9f8aed993c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.566883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2148d-f304-40a9-b989-9f8aed993c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.567152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2148d-f304-40a9-b989-9f8aed993c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.567909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2148d-f304-40a9-b989-9f8aed993c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.569493 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2148d-f304-40a9-b989-9f8aed993c7b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.581658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1281/2579] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:22.585608 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d3356-0432-4837-a446-0feef7b2473a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.595950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d3356-0432-4837-a446-0feef7b2473a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.600844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a625fe-1597-425c-bf0e-70d506980575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.601502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a625fe-1597-425c-bf0e-70d506980575 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.601778 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a625fe-1597-425c-bf0e-70d506980575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.602050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a625fe-1597-425c-bf0e-70d506980575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.602772 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a625fe-1597-425c-bf0e-70d506980575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.604425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a625fe-1597-425c-bf0e-70d506980575 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.614503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1299/2580] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:22.618872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2148d-f304-40a9-b989-9f8aed993c7b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.629518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2148d-f304-40a9-b989-9f8aed993c7b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.634922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5232f1e-a586-4c35-8a42-42206cc64b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.635889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5232f1e-a586-4c35-8a42-42206cc64b8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.636174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5232f1e-a586-4c35-8a42-42206cc64b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.636463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5232f1e-a586-4c35-8a42-42206cc64b8f admin admin] PATH_INFO: `/v3/projects/1b9b32d6e8dd493d98d5cda5ee5a7fa9/users/537001d406f84d97b87faaa6825dde6a/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.651655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5232f1e-a586-4c35-8a42-42206cc64b8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9b32d6e8dd493d98d5cda5ee5a7fa9, user_id=537001d406f84d97b87faaa6825dde6a, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.654448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5232f1e-a586-4c35-8a42-42206cc64b8f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.669083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1282/2581] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:22 2022] PUT /identity/v3/projects/1b9b32d6e8dd493d98d5cda5ee5a7fa9/users/537001d406f84d97b87faaa6825dde6a/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:22.679393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89884178-d68d-47eb-9ce1-5b66ca6511e4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.679713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89884178-d68d-47eb-9ce1-5b66ca6511e4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.679993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89884178-d68d-47eb-9ce1-5b66ca6511e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.706520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-89884178-d68d-47eb-9ce1-5b66ca6511e4 None None] MFA Rules not processed for user `537001d406f84d97b87faaa6825dde6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:22.707795 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-89884178-d68d-47eb-9ce1-5b66ca6511e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:22.773602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1300/2582] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:22.778310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5232f1e-a586-4c35-8a42-42206cc64b8f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.841327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5232f1e-a586-4c35-8a42-42206cc64b8f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.846601 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42f97b-ea10-472a-9cd6-95ea40573ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.847246 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42f97b-ea10-472a-9cd6-95ea40573ef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.847523 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42f97b-ea10-472a-9cd6-95ea40573ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.847837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42f97b-ea10-472a-9cd6-95ea40573ef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.848518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42f97b-ea10-472a-9cd6-95ea40573ef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.850411 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42f97b-ea10-472a-9cd6-95ea40573ef6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.879247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1283/2583] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:22 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:22.885599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89884178-d68d-47eb-9ce1-5b66ca6511e4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.898250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89884178-d68d-47eb-9ce1-5b66ca6511e4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:22.956155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b9712-2c8e-44b8-8e10-6c08633a7596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:22.956827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9712-2c8e-44b8-8e10-6c08633a7596 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:22.957103 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9712-2c8e-44b8-8e10-6c08633a7596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:22.957376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b9712-2c8e-44b8-8e10-6c08633a7596 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:22.958060 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b9712-2c8e-44b8-8e10-6c08633a7596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:22.960002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b9712-2c8e-44b8-8e10-6c08633a7596 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:22.981243 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1301/2584] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:22 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:22.986571 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42f97b-ea10-472a-9cd6-95ea40573ef6 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:22.997781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42f97b-ea10-472a-9cd6-95ea40573ef6 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:23.003455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdf9be-a5c9-4c65-93b3-4fae9882a55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:23.004244 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf9be-a5c9-4c65-93b3-4fae9882a55e admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:23.004529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf9be-a5c9-4c65-93b3-4fae9882a55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:23.004806 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdf9be-a5c9-4c65-93b3-4fae9882a55e admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:23.005558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdf9be-a5c9-4c65-93b3-4fae9882a55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:23.007448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdf9be-a5c9-4c65-93b3-4fae9882a55e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:23.018754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1284/2585] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:23.023334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b9712-2c8e-44b8-8e10-6c08633a7596 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:23.033873 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b9712-2c8e-44b8-8e10-6c08633a7596 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:23.039376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074e5f7-043a-491f-ac31-ee589273d890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:23.040312 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074e5f7-043a-491f-ac31-ee589273d890 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:23.040592 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074e5f7-043a-491f-ac31-ee589273d890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:23.040864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7074e5f7-043a-491f-ac31-ee589273d890 admin admin] PATH_INFO: `/v3/projects/90855f19ad6e4aeda8c726a77c311c54/users/a2f296eb2d314d22b07d5dfe03d1170e/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:23.055986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074e5f7-043a-491f-ac31-ee589273d890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90855f19ad6e4aeda8c726a77c311c54, user_id=a2f296eb2d314d22b07d5dfe03d1170e, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:23.058626 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7074e5f7-043a-491f-ac31-ee589273d890 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:23.073002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1302/2586] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:23 2022] PUT /identity/v3/projects/90855f19ad6e4aeda8c726a77c311c54/users/a2f296eb2d314d22b07d5dfe03d1170e/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:23.077360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdf9be-a5c9-4c65-93b3-4fae9882a55e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:23.087878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdf9be-a5c9-4c65-93b3-4fae9882a55e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:23.133849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:23.146458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f7589-baa3-44a0-9734-ed52984697e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:23.147159 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7589-baa3-44a0-9734-ed52984697e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:23.147463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7589-baa3-44a0-9734-ed52984697e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:23.147931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f7589-baa3-44a0-9734-ed52984697e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:23.148679 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f7589-baa3-44a0-9734-ed52984697e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:23.150298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f7589-baa3-44a0-9734-ed52984697e7 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:23.160872 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1285/2587] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:23.165424 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074e5f7-043a-491f-ac31-ee589273d890 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:23.171110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:23.177762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7074e5f7-043a-491f-ac31-ee589273d890 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:23.182938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:23.183874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:23.184160 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:23.184439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] PATH_INFO: `/v3/projects/90855f19ad6e4aeda8c726a77c311c54/users/a2f296eb2d314d22b07d5dfe03d1170e/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:23.186468 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90855f19ad6e4aeda8c726a77c311c54, user_id=a2f296eb2d314d22b07d5dfe03d1170e, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:23.189293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:23.200853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1303/2588] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:23 2022] PUT /identity/v3/projects/90855f19ad6e4aeda8c726a77c311c54/users/a2f296eb2d314d22b07d5dfe03d1170e/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:23.268941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6307ad-0917-48e9-83ef-0819b261edbc None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:23.269181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6307ad-0917-48e9-83ef-0819b261edbc None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:23.269518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6307ad-0917-48e9-83ef-0819b261edbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:23.296768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-dc6307ad-0917-48e9-83ef-0819b261edbc None None] MFA Rules not processed for user `a2f296eb2d314d22b07d5dfe03d1170e`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:23.297941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-dc6307ad-0917-48e9-83ef-0819b261edbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:23.369423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1286/2589] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:23.380888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:23.382996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:23.449800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116ebcb-3c78-4a18-8804-763437dd7403 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:23.454219 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d73042-5a9a-4eba-af2c-b638d1559cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:23.454925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d73042-5a9a-4eba-af2c-b638d1559cef service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:23.455209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d73042-5a9a-4eba-af2c-b638d1559cef service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:23.455542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d73042-5a9a-4eba-af2c-b638d1559cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:23.514956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d73042-5a9a-4eba-af2c-b638d1559cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:23.516497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d73042-5a9a-4eba-af2c-b638d1559cef service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:23.525676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1304/2590] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:50:26.073388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6307ad-0917-48e9-83ef-0819b261edbc None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:26.152363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6307ad-0917-48e9-83ef-0819b261edbc None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:26.157489 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:26.158422 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:26.158701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:26.158973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] PATH_INFO: `/v3/users/537001d406f84d97b87faaa6825dde6a` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:26.160292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=537001d406f84d97b87faaa6825dde6a)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:26.162200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:26.211724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '537001d406f84d97b87faaa6825dde6a'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.223128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '537001d406f84d97b87faaa6825dde6a'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.223986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '537001d406f84d97b87faaa6825dde6a'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.232025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '537001d406f84d97b87faaa6825dde6a'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.239775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:26.245184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '537001d406f84d97b87faaa6825dde6a'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.252257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1287/2591] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:26 2022] DELETE /identity/v3/users/537001d406f84d97b87faaa6825dde6a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:26.256853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3d586-16a1-4940-abe6-07b3d68bb3ce None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:26.257356 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3d586-16a1-4940-abe6-07b3d68bb3ce None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:26.257459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3d586-16a1-4940-abe6-07b3d68bb3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:26.275475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d2b3d586-16a1-4940-abe6-07b3d68bb3ce None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:26.276827 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d2b3d586-16a1-4940-abe6-07b3d68bb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:26.343735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1305/2592] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:26.353639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:26.355117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:26.418950 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e31103-1131-4b58-a84f-0c892d702c33 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:26.422964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b66e3d-eb19-4710-9ad5-a1e70aba8632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:26.423627 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66e3d-eb19-4710-9ad5-a1e70aba8632 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:26.423935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66e3d-eb19-4710-9ad5-a1e70aba8632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:26.424209 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b66e3d-eb19-4710-9ad5-a1e70aba8632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:26.433680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66e3d-eb19-4710-9ad5-a1e70aba8632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:26.435157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b66e3d-eb19-4710-9ad5-a1e70aba8632 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:26.444705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1288/2593] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:50:26.726733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3d586-16a1-4940-abe6-07b3d68bb3ce None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:26.728249 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d2b3d586-16a1-4940-abe6-07b3d68bb3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:26.744948 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3d586-16a1-4940-abe6-07b3d68bb3ce None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:26.750296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:26.751362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:26.751677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:26.752068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] PATH_INFO: `/v3/projects/1b9b32d6e8dd493d98d5cda5ee5a7fa9` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:26.753368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9b32d6e8dd493d98d5cda5ee5a7fa9)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:26.755212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:26.797818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:26.806178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9b32d6e8dd493d98d5cda5ee5a7fa9', 'request_id': 'req-6b7d513e-41a9-49ec-b851-3cc523e373fc'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.814163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9b32d6e8dd493d98d5cda5ee5a7fa9', 'request_id': 'req-6b7d513e-41a9-49ec-b851-3cc523e373fc'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.822663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9b32d6e8dd493d98d5cda5ee5a7fa9', 'request_id': 'req-6b7d513e-41a9-49ec-b851-3cc523e373fc'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.833314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] The token cache is being invalidate because project 1b9b32d6e8dd493d98d5cda5ee5a7fa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:26.833599 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.834220 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.835837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1306/2594] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:26 2022] DELETE /identity/v3/projects/1b9b32d6e8dd493d98d5cda5ee5a7fa9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:26.840280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b66e3d-eb19-4710-9ad5-a1e70aba8632 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:26.850326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b66e3d-eb19-4710-9ad5-a1e70aba8632 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:26.908062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:26.908864 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:26.909143 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:26.909423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] PATH_INFO: `/v3/users/a2f296eb2d314d22b07d5dfe03d1170e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:26.910651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2f296eb2d314d22b07d5dfe03d1170e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:26.912672 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:26.961251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2f296eb2d314d22b07d5dfe03d1170e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.970061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2f296eb2d314d22b07d5dfe03d1170e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.970712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2f296eb2d314d22b07d5dfe03d1170e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.978042 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2f296eb2d314d22b07d5dfe03d1170e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.990139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-0c4e05d1-5e56-4af3-8ca2-74e8c0aeb5a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2f296eb2d314d22b07d5dfe03d1170e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:26.996356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1289/2595] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:26 2022] DELETE /identity/v3/users/a2f296eb2d314d22b07d5dfe03d1170e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:27.269322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:27.270831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:27.284607 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d513e-41a9-49ec-b851-3cc523e373fc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:27.346057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:27.346984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.347295 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.347552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] PATH_INFO: `/v3/projects/90855f19ad6e4aeda8c726a77c311c54` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.348897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90855f19ad6e4aeda8c726a77c311c54)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:27.350880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:27.399783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90855f19ad6e4aeda8c726a77c311c54', 'request_id': 'req-1fc57cef-95bb-48aa-9bc7-67721378cc32'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:27.405877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90855f19ad6e4aeda8c726a77c311c54', 'request_id': 'req-1fc57cef-95bb-48aa-9bc7-67721378cc32'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:27.414579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90855f19ad6e4aeda8c726a77c311c54', 'request_id': 'req-1fc57cef-95bb-48aa-9bc7-67721378cc32'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:27.425165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] The token cache is being invalidate because project 90855f19ad6e4aeda8c726a77c311c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:27.425449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:27.426084 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-1fc57cef-95bb-48aa-9bc7-67721378cc32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:27.427645 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1307/2596] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:27 2022] DELETE /identity/v3/projects/90855f19ad6e4aeda8c726a77c311c54 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:27.433647 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab0c1d-6d01-4257-a57a-ee84d574a358 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.434186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab0c1d-6d01-4257-a57a-ee84d574a358 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.434646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab0c1d-6d01-4257-a57a-ee84d574a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.459694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-e5ab0c1d-6d01-4257-a57a-ee84d574a358 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:27.460916 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-e5ab0c1d-6d01-4257-a57a-ee84d574a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:27.473207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:27.535455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1290/2597] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:27.544646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360921c5-ec20-479e-aee1-33b4b5fc1b64 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.544991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360921c5-ec20-479e-aee1-33b4b5fc1b64 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.545277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360921c5-ec20-479e-aee1-33b4b5fc1b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.573704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-360921c5-ec20-479e-aee1-33b4b5fc1b64 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:27.575284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-360921c5-ec20-479e-aee1-33b4b5fc1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:27.584708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1308/2598] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:27.589363 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab0c1d-6d01-4257-a57a-ee84d574a358 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:27.599818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab0c1d-6d01-4257-a57a-ee84d574a358 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:27.605127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:27.605795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.606083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.606362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.607128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:27.607439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:27.609116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:27.620885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1291/2599] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:27.625310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360921c5-ec20-479e-aee1-33b4b5fc1b64 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:27.635053 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360921c5-ec20-479e-aee1-33b4b5fc1b64 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:27.640360 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9169980-d5a6-4b8c-8047-beb3675aff04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:27.641036 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9169980-d5a6-4b8c-8047-beb3675aff04 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.641314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9169980-d5a6-4b8c-8047-beb3675aff04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.641584 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9169980-d5a6-4b8c-8047-beb3675aff04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.642299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9169980-d5a6-4b8c-8047-beb3675aff04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:27.644270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9169980-d5a6-4b8c-8047-beb3675aff04 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:27.673148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1309/2600] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:27 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:27.677425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:27.688612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cceef-888c-4db7-b4d6-a94b1c737dc0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:27.754292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a185e8-970b-4ee5-89b2-5bd1561b4f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:27.754876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a185e8-970b-4ee5-89b2-5bd1561b4f43 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.755188 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a185e8-970b-4ee5-89b2-5bd1561b4f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.755462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a185e8-970b-4ee5-89b2-5bd1561b4f43 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.756207 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a185e8-970b-4ee5-89b2-5bd1561b4f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:27.758166 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a185e8-970b-4ee5-89b2-5bd1561b4f43 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:27.780797 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1292/2601] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:27 2022] POST /identity/v3/users => generated 285 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:27.785593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9169980-d5a6-4b8c-8047-beb3675aff04 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:27.796907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9169980-d5a6-4b8c-8047-beb3675aff04 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:27.801963 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c0025-7328-44cb-876c-922605528a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:27.802634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c0025-7328-44cb-876c-922605528a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.802918 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c0025-7328-44cb-876c-922605528a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.803191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c0025-7328-44cb-876c-922605528a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.803979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c0025-7328-44cb-876c-922605528a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:27.805591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c0025-7328-44cb-876c-922605528a1a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:27.819054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1310/2602] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:27.824926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a185e8-970b-4ee5-89b2-5bd1561b4f43 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:27.836889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a185e8-970b-4ee5-89b2-5bd1561b4f43 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:27.842503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d306db-ef94-4ab8-8238-d830f981e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:27.843176 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d306db-ef94-4ab8-8238-d830f981e403 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.843457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d306db-ef94-4ab8-8238-d830f981e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.843777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d306db-ef94-4ab8-8238-d830f981e403 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.844507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d306db-ef94-4ab8-8238-d830f981e403 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:27.846100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d306db-ef94-4ab8-8238-d830f981e403 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:27.857022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1293/2603] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:27.861653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c0025-7328-44cb-876c-922605528a1a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:27.872171 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c0025-7328-44cb-876c-922605528a1a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:27.877277 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:27.878235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.878522 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.878801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] PATH_INFO: `/v3/projects/7a868997c83643c48fb634034a536749/users/a0789c5d4dd246608b85ebe91d743daa/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.893677 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a868997c83643c48fb634034a536749, user_id=a0789c5d4dd246608b85ebe91d743daa, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:27.896379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:27.898576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:27.911673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1311/2604] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:27 2022] PUT /identity/v3/projects/7a868997c83643c48fb634034a536749/users/a0789c5d4dd246608b85ebe91d743daa/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:27.922344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9331c41-798b-438a-ba78-2c27e71b3d7d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:27.922638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9331c41-798b-438a-ba78-2c27e71b3d7d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:27.922918 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9331c41-798b-438a-ba78-2c27e71b3d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:27.951509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f9331c41-798b-438a-ba78-2c27e71b3d7d None None] MFA Rules not processed for user `a0789c5d4dd246608b85ebe91d743daa`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:27.952786 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f9331c41-798b-438a-ba78-2c27e71b3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:28.021568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1294/2605] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:28.033430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:28.035140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:28.094844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2ec58-15d7-43fe-b3fd-fd06b9b4ead9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:28.098898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:28.099885 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:28.100383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:28.100665 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:28.110448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:28.111474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:28.121351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1312/2606] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:28 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:38.018690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:38.117496 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:42.758744 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9331c41-798b-438a-ba78-2c27e71b3d7d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:42.760459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f9331c41-798b-438a-ba78-2c27e71b3d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:42.822724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9331c41-798b-438a-ba78-2c27e71b3d7d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:42.827953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:42.828614 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:42.828902 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:42.829176 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:42.831990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:42.902735 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:42.904146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:42.913962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1295/2607] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:46.253016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:46.254884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:46.271031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f7aab-91b1-4fb0-8667-79d6a6512760 service glance] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:46.276708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:46.277629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:46.277915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:46.278196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] PATH_INFO: `/v3/users/636181e787714128869124b40ab14c6b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:46.279499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=636181e787714128869124b40ab14c6b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:46.281509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:46.334450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '636181e787714128869124b40ab14c6b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.335201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '636181e787714128869124b40ab14c6b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.345247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '636181e787714128869124b40ab14c6b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.352543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '636181e787714128869124b40ab14c6b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.353175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-77ba7c3b-cb1f-40a7-bff9-41dbf9d161d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '636181e787714128869124b40ab14c6b'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.369860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1313/2608] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:46 2022] DELETE /identity/v3/users/636181e787714128869124b40ab14c6b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:46.618737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:46.631470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb27f6-b20c-4f85-80c0-0f61819aa77f service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:46.713350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:46.714281 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:46.714569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:46.714888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] PATH_INFO: `/v3/projects/684fc455699445a6b24c277518cc9bf4` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:46.716145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=684fc455699445a6b24c277518cc9bf4)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:46.718144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:46.772032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '684fc455699445a6b24c277518cc9bf4', 'request_id': 'req-80155500-3bc1-4d8b-b75c-34470dcd6068'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.774642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:46.781241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '684fc455699445a6b24c277518cc9bf4', 'request_id': 'req-80155500-3bc1-4d8b-b75c-34470dcd6068'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.788706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '684fc455699445a6b24c277518cc9bf4', 'request_id': 'req-80155500-3bc1-4d8b-b75c-34470dcd6068'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.801013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] The token cache is being invalidate because project 684fc455699445a6b24c277518cc9bf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:46.801299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.802604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-80155500-3bc1-4d8b-b75c-34470dcd6068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:46.804252 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1296/2609] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:46 2022] DELETE /identity/v3/projects/684fc455699445a6b24c277518cc9bf4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:46.809412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34498e1-c27a-46fd-9e8b-e0565dfb985d None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:46.809789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34498e1-c27a-46fd-9e8b-e0565dfb985d None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:46.810126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34498e1-c27a-46fd-9e8b-e0565dfb985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:46.828555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c34498e1-c27a-46fd-9e8b-e0565dfb985d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:46.829796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c34498e1-c27a-46fd-9e8b-e0565dfb985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:46.898011 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1314/2610] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:46.906178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a967-9079-472f-b1a8-e00d2c1bc0f9 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:46.906507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a967-9079-472f-b1a8-e00d2c1bc0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:46.906785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af8a967-9079-472f-b1a8-e00d2c1bc0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:46.927056 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1af8a967-9079-472f-b1a8-e00d2c1bc0f9 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:46.928465 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1af8a967-9079-472f-b1a8-e00d2c1bc0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:46.938155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1297/2611] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:46.942790 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34498e1-c27a-46fd-9e8b-e0565dfb985d None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:46.953983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34498e1-c27a-46fd-9e8b-e0565dfb985d None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:46.959826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:46.960508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:46.960795 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:46.961064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:46.961813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:46.962096 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:46.963711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:46.975655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1315/2612] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:46.980309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8a967-9079-472f-b1a8-e00d2c1bc0f9 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:46.990425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af8a967-9079-472f-b1a8-e00d2c1bc0f9 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:46.995638 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955cc61-4d06-45cf-a0a4-fd3259f16ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:46.996471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955cc61-4d06-45cf-a0a4-fd3259f16ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:46.996762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955cc61-4d06-45cf-a0a4-fd3259f16ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:46.997048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955cc61-4d06-45cf-a0a4-fd3259f16ac0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:46.997821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955cc61-4d06-45cf-a0a4-fd3259f16ac0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:46.999793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955cc61-4d06-45cf-a0a4-fd3259f16ac0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.027232 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1298/2613] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:46 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:47.031577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.044151 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf9c85-d21d-4b97-9f38-a39cf405e4e2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.106086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243fc5-c566-4e89-aaf2-17f5e2f0f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.106756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243fc5-c566-4e89-aaf2-17f5e2f0f9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.107033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243fc5-c566-4e89-aaf2-17f5e2f0f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.107304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a243fc5-c566-4e89-aaf2-17f5e2f0f9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.108027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a243fc5-c566-4e89-aaf2-17f5e2f0f9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.110031 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a243fc5-c566-4e89-aaf2-17f5e2f0f9e2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.116825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:47.133539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1316/2614] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:47 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:47.137727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955cc61-4d06-45cf-a0a4-fd3259f16ac0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.149439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955cc61-4d06-45cf-a0a4-fd3259f16ac0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.157036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f187c-a0aa-4863-ad43-fdfc99670b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.157853 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f187c-a0aa-4863-ad43-fdfc99670b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.158140 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f187c-a0aa-4863-ad43-fdfc99670b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.158413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735f187c-a0aa-4863-ad43-fdfc99670b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.159150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f187c-a0aa-4863-ad43-fdfc99670b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.160820 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735f187c-a0aa-4863-ad43-fdfc99670b60 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.172857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1299/2615] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:47.177284 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243fc5-c566-4e89-aaf2-17f5e2f0f9e2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.187740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a243fc5-c566-4e89-aaf2-17f5e2f0f9e2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.192566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d5454-a6e8-47be-b563-66022cdfb2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.193242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d5454-a6e8-47be-b563-66022cdfb2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.193525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d5454-a6e8-47be-b563-66022cdfb2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.193801 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d5454-a6e8-47be-b563-66022cdfb2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.194539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d5454-a6e8-47be-b563-66022cdfb2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.196225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d5454-a6e8-47be-b563-66022cdfb2ce admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.209945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1317/2616] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:47.214193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f187c-a0aa-4863-ad43-fdfc99670b60 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.226717 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735f187c-a0aa-4863-ad43-fdfc99670b60 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.232503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3049b-ce68-41db-858b-07de17526a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.233446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3049b-ce68-41db-858b-07de17526a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.233748 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3049b-ce68-41db-858b-07de17526a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.234030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c3049b-ce68-41db-858b-07de17526a63 admin admin] PATH_INFO: `/v3/projects/a42bedd59b5746c1b4c670c8164cf879/users/cac1298b0c924177aad6e52a8abebbb6/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.252898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3049b-ce68-41db-858b-07de17526a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42bedd59b5746c1b4c670c8164cf879, user_id=cac1298b0c924177aad6e52a8abebbb6, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.259777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c3049b-ce68-41db-858b-07de17526a63 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.279830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1300/2617] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:47 2022] PUT /identity/v3/projects/a42bedd59b5746c1b4c670c8164cf879/users/cac1298b0c924177aad6e52a8abebbb6/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:47.287017 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab23ca-6d05-4c30-aacf-f451da83fd66 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.287491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab23ca-6d05-4c30-aacf-f451da83fd66 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.287785 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaab23ca-6d05-4c30-aacf-f451da83fd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.320662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-eaab23ca-6d05-4c30-aacf-f451da83fd66 None None] MFA Rules not processed for user `cac1298b0c924177aad6e52a8abebbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:47.322126 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-eaab23ca-6d05-4c30-aacf-f451da83fd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:47.428993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1318/2618] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:47.434015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3049b-ce68-41db-858b-07de17526a63 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.519084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c3049b-ce68-41db-858b-07de17526a63 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.524705 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c407a0-1bcb-40cb-b4ea-534713687e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.525439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c407a0-1bcb-40cb-b4ea-534713687e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.525791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c407a0-1bcb-40cb-b4ea-534713687e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.525981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c407a0-1bcb-40cb-b4ea-534713687e9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.526691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c407a0-1bcb-40cb-b4ea-534713687e9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.528704 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c407a0-1bcb-40cb-b4ea-534713687e9f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.560626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1301/2619] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:47 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:47.561983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab23ca-6d05-4c30-aacf-f451da83fd66 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.575651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaab23ca-6d05-4c30-aacf-f451da83fd66 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.635281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69cd47-ce35-46c6-a9f4-a14e1537bbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.636022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69cd47-ce35-46c6-a9f4-a14e1537bbbe admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.636305 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69cd47-ce35-46c6-a9f4-a14e1537bbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.636581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69cd47-ce35-46c6-a9f4-a14e1537bbbe admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.637300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69cd47-ce35-46c6-a9f4-a14e1537bbbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.639216 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a69cd47-ce35-46c6-a9f4-a14e1537bbbe admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.665343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1319/2620] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:47 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:47.669347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c407a0-1bcb-40cb-b4ea-534713687e9f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.679731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c407a0-1bcb-40cb-b4ea-534713687e9f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.684442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362fc0-a1ef-4112-ab20-cdb393d55e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.685120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362fc0-a1ef-4112-ab20-cdb393d55e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.685408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362fc0-a1ef-4112-ab20-cdb393d55e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.685691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9362fc0-a1ef-4112-ab20-cdb393d55e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.686459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9362fc0-a1ef-4112-ab20-cdb393d55e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.688103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9362fc0-a1ef-4112-ab20-cdb393d55e37 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.698759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1302/2621] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:47.703292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69cd47-ce35-46c6-a9f4-a14e1537bbbe admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.714215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69cd47-ce35-46c6-a9f4-a14e1537bbbe admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.719158 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406f5c-27fa-42f0-802b-349acc35404a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.720218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406f5c-27fa-42f0-802b-349acc35404a admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.720578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406f5c-27fa-42f0-802b-349acc35404a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.720981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69406f5c-27fa-42f0-802b-349acc35404a admin admin] PATH_INFO: `/v3/projects/d64780d3e8cf4e5c8adb8268135040e2/users/fa67b2f0b5ad478aa4077ce60102274b/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.740441 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406f5c-27fa-42f0-802b-349acc35404a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64780d3e8cf4e5c8adb8268135040e2, user_id=fa67b2f0b5ad478aa4077ce60102274b, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.743087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69406f5c-27fa-42f0-802b-349acc35404a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.760119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1320/2622] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:47 2022] PUT /identity/v3/projects/d64780d3e8cf4e5c8adb8268135040e2/users/fa67b2f0b5ad478aa4077ce60102274b/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:47.763907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362fc0-a1ef-4112-ab20-cdb393d55e37 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.774583 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9362fc0-a1ef-4112-ab20-cdb393d55e37 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.830674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:47.842831 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de58d6-2fb1-4306-be6a-0b7a868f45be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.847104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de58d6-2fb1-4306-be6a-0b7a868f45be admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.847104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de58d6-2fb1-4306-be6a-0b7a868f45be admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.847104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de58d6-2fb1-4306-be6a-0b7a868f45be admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.847428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de58d6-2fb1-4306-be6a-0b7a868f45be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.849154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de58d6-2fb1-4306-be6a-0b7a868f45be admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.863271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1303/2623] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:47.864616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406f5c-27fa-42f0-802b-349acc35404a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:47.878770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69406f5c-27fa-42f0-802b-349acc35404a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:47.886731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:47.888039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.888323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.888993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] PATH_INFO: `/v3/projects/d64780d3e8cf4e5c8adb8268135040e2/users/fa67b2f0b5ad478aa4077ce60102274b/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.892447 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64780d3e8cf4e5c8adb8268135040e2, user_id=fa67b2f0b5ad478aa4077ce60102274b, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:47.899802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:47.923660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1321/2624] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:47 2022] PUT /identity/v3/projects/d64780d3e8cf4e5c8adb8268135040e2/users/fa67b2f0b5ad478aa4077ce60102274b/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:47.931257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b00c-7f99-4b7d-a36c-3f3bd9b3d064 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:47.931541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b00c-7f99-4b7d-a36c-3f3bd9b3d064 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:47.932049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33b00c-7f99-4b7d-a36c-3f3bd9b3d064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:47.969709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ab33b00c-7f99-4b7d-a36c-3f3bd9b3d064 None None] MFA Rules not processed for user `fa67b2f0b5ad478aa4077ce60102274b`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:47.971004 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ab33b00c-7f99-4b7d-a36c-3f3bd9b3d064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:48.051651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1304/2625] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:48.064231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:48.066148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:48.090244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:48.134170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d2c95-ffb3-43f6-816e-a224410be4f1 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:48.139120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:48.139825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:48.140108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:48.140382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:48.208476 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:48.210001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:48.226322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1322/2626] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:49.660087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33b00c-7f99-4b7d-a36c-3f3bd9b3d064 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:49.661669 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ab33b00c-7f99-4b7d-a36c-3f3bd9b3d064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:49.674802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33b00c-7f99-4b7d-a36c-3f3bd9b3d064 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:49.678850 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c7af-d347-4703-acd3-13eba5ae1b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:49.679508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c7af-d347-4703-acd3-13eba5ae1b11 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:49.679825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c7af-d347-4703-acd3-13eba5ae1b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:49.680100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989c7af-d347-4703-acd3-13eba5ae1b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:49.690216 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989c7af-d347-4703-acd3-13eba5ae1b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:49.691645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989c7af-d347-4703-acd3-13eba5ae1b11 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:49.702060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1305/2627] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:51.788059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:51.789553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:51.855336 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d204df-d71e-40e8-9d36-e4348fcb7027 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:51.859194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3908db76-7b43-40d0-a3a0-f99fa2c0b0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:51.859896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908db76-7b43-40d0-a3a0-f99fa2c0b0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:51.860180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908db76-7b43-40d0-a3a0-f99fa2c0b0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:51.860457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3908db76-7b43-40d0-a3a0-f99fa2c0b0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:51.862238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3908db76-7b43-40d0-a3a0-f99fa2c0b0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:51.926541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908db76-7b43-40d0-a3a0-f99fa2c0b0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:51.928040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3908db76-7b43-40d0-a3a0-f99fa2c0b0d1 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:51.938464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1323/2628] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:53.753792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c7af-d347-4703-acd3-13eba5ae1b11 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:53.764849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989c7af-d347-4703-acd3-13eba5ae1b11 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:53.770165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:53.771051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:53.771333 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:53.771644 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] PATH_INFO: `/v3/users/cac1298b0c924177aad6e52a8abebbb6` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:53.772932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cac1298b0c924177aad6e52a8abebbb6)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:53.774869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:53.825837 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cac1298b0c924177aad6e52a8abebbb6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:53.854405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cac1298b0c924177aad6e52a8abebbb6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:53.855194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cac1298b0c924177aad6e52a8abebbb6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:53.867626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cac1298b0c924177aad6e52a8abebbb6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:53.877490 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cac1298b0c924177aad6e52a8abebbb6'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:53.889340 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1306/2629] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:53 2022] DELETE /identity/v3/users/cac1298b0c924177aad6e52a8abebbb6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:53.891642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290a1a-bc7f-4b41-9243-45134cec1912 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:53.891642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290a1a-bc7f-4b41-9243-45134cec1912 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:53.891642 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7290a1a-bc7f-4b41-9243-45134cec1912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:53.913572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b7290a1a-bc7f-4b41-9243-45134cec1912 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:53.915497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b7290a1a-bc7f-4b41-9243-45134cec1912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:53.941748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:53.986217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1324/2630] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:53.996248 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:53.997655 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:54.039152 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:54.067121 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9252643-a33d-4c76-ac41-dba5872cd086 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:54.071896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a29d3-be60-4e08-acac-b137c2363f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:54.072779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a29d3-be60-4e08-acac-b137c2363f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:54.073292 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a29d3-be60-4e08-acac-b137c2363f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:54.073674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a29d3-be60-4e08-acac-b137c2363f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:54.085259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a29d3-be60-4e08-acac-b137c2363f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:54.086777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a29d3-be60-4e08-acac-b137c2363f68 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:54.097748 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1307/2631] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:54.494826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290a1a-bc7f-4b41-9243-45134cec1912 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:54.496896 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b7290a1a-bc7f-4b41-9243-45134cec1912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:54.517253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7290a1a-bc7f-4b41-9243-45134cec1912 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:54.524814 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:54.526008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:54.526283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:54.526552 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] PATH_INFO: `/v3/projects/a42bedd59b5746c1b4c670c8164cf879` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:54.527788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42bedd59b5746c1b4c670c8164cf879)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:54.529733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:54.586274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42bedd59b5746c1b4c670c8164cf879', 'request_id': 'req-d9a7b016-797a-404b-a379-4d8c55075e00'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.593737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42bedd59b5746c1b4c670c8164cf879', 'request_id': 'req-d9a7b016-797a-404b-a379-4d8c55075e00'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.606713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42bedd59b5746c1b4c670c8164cf879', 'request_id': 'req-d9a7b016-797a-404b-a379-4d8c55075e00'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.623643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] The token cache is being invalidate because project a42bedd59b5746c1b4c670c8164cf879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:54.623821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.624376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.625927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1325/2632] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:54 2022] DELETE /identity/v3/projects/a42bedd59b5746c1b4c670c8164cf879 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:54.630025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a29d3-be60-4e08-acac-b137c2363f68 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:54.641034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a29d3-be60-4e08-acac-b137c2363f68 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:54.722322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:54.723680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:54.724195 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:54.724854 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] PATH_INFO: `/v3/users/fa67b2f0b5ad478aa4077ce60102274b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:54.730526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa67b2f0b5ad478aa4077ce60102274b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:54.732863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:54.793840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa67b2f0b5ad478aa4077ce60102274b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.803224 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa67b2f0b5ad478aa4077ce60102274b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.804030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa67b2f0b5ad478aa4077ce60102274b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.812508 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa67b2f0b5ad478aa4077ce60102274b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.825600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa67b2f0b5ad478aa4077ce60102274b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:54.841981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1308/2633] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:54 2022] DELETE /identity/v3/users/fa67b2f0b5ad478aa4077ce60102274b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:55.025211 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.027386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.116532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.118322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.136404 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a7b016-797a-404b-a379-4d8c55075e00 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.206763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:55.208059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:55.225783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5847cad-7c63-410c-b3f3-8857c9adf0ce admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.227343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.228189 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.228474 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.228879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.230760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.230898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.231765 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.232051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.232324 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] PATH_INFO: `/v3/users/0b6134cfb9cf44a9bc86f6c639283b24` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.233513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6134cfb9cf44a9bc86f6c639283b24)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.235476 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.243536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.245971 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.257541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1326/2634] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:55.258433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.260388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.275039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeca526-79fa-4716-934b-6eab58fe4383 service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.280720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.281731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.282076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.282413 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] PATH_INFO: `/v3/users/a0789c5d4dd246608b85ebe91d743daa` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.283757 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0789c5d4dd246608b85ebe91d743daa)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.285780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.293362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6134cfb9cf44a9bc86f6c639283b24'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.301369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6134cfb9cf44a9bc86f6c639283b24'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.302034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6134cfb9cf44a9bc86f6c639283b24'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.311119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6134cfb9cf44a9bc86f6c639283b24'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.324374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6134cfb9cf44a9bc86f6c639283b24'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.331006 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1309/2635] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:55 2022] DELETE /identity/v3/users/0b6134cfb9cf44a9bc86f6c639283b24 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:55.333454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.335179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.335870 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0789c5d4dd246608b85ebe91d743daa'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.336837 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0789c5d4dd246608b85ebe91d743daa'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.346325 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0789c5d4dd246608b85ebe91d743daa'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.355905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0789c5d4dd246608b85ebe91d743daa'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.356864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9b9be7d2-2aa9-42c5-8164-2fba8ff7a00e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0789c5d4dd246608b85ebe91d743daa'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.385803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1327/2636] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:50:55 2022] DELETE /identity/v3/users/a0789c5d4dd246608b85ebe91d743daa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:55.390291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5bff-0b9e-46fa-b0fc-680f33100fe7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.390672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5bff-0b9e-46fa-b0fc-680f33100fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.390856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152c5bff-0b9e-46fa-b0fc-680f33100fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.411349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263eab0c-8840-468b-bc46-b038f2c792da admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.415240 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-152c5bff-0b9e-46fa-b0fc-680f33100fe7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:55.416591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-152c5bff-0b9e-46fa-b0fc-680f33100fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.488000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.488893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.489157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.489425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] PATH_INFO: `/v3/projects/d64780d3e8cf4e5c8adb8268135040e2` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.490753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64780d3e8cf4e5c8adb8268135040e2)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.493361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1328/2637] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:55.493593 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.503449 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c5bff-0b9e-46fa-b0fc-680f33100fe7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.512057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-152c5bff-0b9e-46fa-b0fc-680f33100fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.518022 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:55.555328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64780d3e8cf4e5c8adb8268135040e2', 'request_id': 'req-5db26561-1be8-4eea-b257-7815d33a8f30'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.565184 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64780d3e8cf4e5c8adb8268135040e2', 'request_id': 'req-5db26561-1be8-4eea-b257-7815d33a8f30'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.571809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64780d3e8cf4e5c8adb8268135040e2', 'request_id': 'req-5db26561-1be8-4eea-b257-7815d33a8f30'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.583480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152c5bff-0b9e-46fa-b0fc-680f33100fe7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.583691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] The token cache is being invalidate because project d64780d3e8cf4e5c8adb8268135040e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:55.583891 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.584649 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.586289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1310/2638] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:55 2022] DELETE /identity/v3/projects/d64780d3e8cf4e5c8adb8268135040e2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:55.589012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:55.590541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.592036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.635999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ba013-715a-4e12-90be-86766d32bff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.636651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba013-715a-4e12-90be-86766d32bff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.636928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba013-715a-4e12-90be-86766d32bff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.637195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ba013-715a-4e12-90be-86766d32bff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.638985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0d1ba013-715a-4e12-90be-86766d32bff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.663145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db26561-1be8-4eea-b257-7815d33a8f30 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.667948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.668887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.669170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.669481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] PATH_INFO: `/v3/projects/d105517f5def4d1eb9229b9bcab9cadb` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.670701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d105517f5def4d1eb9229b9bcab9cadb)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.672675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.708953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ba013-715a-4e12-90be-86766d32bff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.710436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ba013-715a-4e12-90be-86766d32bff2 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.720125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1329/2639] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:50:55.721269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7bd02-d5ed-4dcf-b8fd-fbd2fd178913 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.721556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7bd02-d5ed-4dcf-b8fd-fbd2fd178913 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.721888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f7bd02-d5ed-4dcf-b8fd-fbd2fd178913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.723328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd105517f5def4d1eb9229b9bcab9cadb', 'request_id': 'req-03baee4c-7eac-469d-bd95-894330ab53bc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.732389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd105517f5def4d1eb9229b9bcab9cadb', 'request_id': 'req-03baee4c-7eac-469d-bd95-894330ab53bc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.738764 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd105517f5def4d1eb9229b9bcab9cadb', 'request_id': 'req-03baee4c-7eac-469d-bd95-894330ab53bc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.742251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-50f7bd02-d5ed-4dcf-b8fd-fbd2fd178913 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:55.743577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-50f7bd02-d5ed-4dcf-b8fd-fbd2fd178913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.751260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] The token cache is being invalidate because project d105517f5def4d1eb9229b9bcab9cadb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:55.751690 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.752464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-03baee4c-7eac-469d-bd95-894330ab53bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:55.754966 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1311/2640] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:55 2022] DELETE /identity/v3/projects/d105517f5def4d1eb9229b9bcab9cadb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:55.759982 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466854e-e298-4a70-9118-7699aa1d3474 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.760474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466854e-e298-4a70-9118-7699aa1d3474 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.760833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466854e-e298-4a70-9118-7699aa1d3474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.780829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-f466854e-e298-4a70-9118-7699aa1d3474 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:55.781708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f466854e-e298-4a70-9118-7699aa1d3474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.815817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1330/2641] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:55.818574 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:55.825547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284e95d-aeab-47a4-b9b6-88b24af2340b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.825783 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284e95d-aeab-47a4-b9b6-88b24af2340b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.825999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0284e95d-aeab-47a4-b9b6-88b24af2340b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.862528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1312/2642] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:55.862775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-0284e95d-aeab-47a4-b9b6-88b24af2340b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:55.862775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-0284e95d-aeab-47a4-b9b6-88b24af2340b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.864487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a923db5-b698-4b60-adb4-396494dafcb3 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.871790 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a923db5-b698-4b60-adb4-396494dafcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.871790 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a923db5-b698-4b60-adb4-396494dafcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.872076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1331/2643] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:50:55.873365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284e95d-aeab-47a4-b9b6-88b24af2340b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.883088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0284e95d-aeab-47a4-b9b6-88b24af2340b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.889024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.889707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.889998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.890274 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.891080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:55.891391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.893025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.902094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-2a923db5-b698-4b60-adb4-396494dafcb3 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:55.903462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2a923db5-b698-4b60-adb4-396494dafcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:55.909768 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1332/2644] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:50:55.919673 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1313/2645] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:55.921133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a923db5-b698-4b60-adb4-396494dafcb3 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.924175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.931590 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a923db5-b698-4b60-adb4-396494dafcb3 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.936793 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.937642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.938033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.938373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.939374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:55.940076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.941384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d16341a-bd82-430f-9161-1d1571ddf230 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.942234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.948170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecba1d-a628-41ff-a973-3931b17b8da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.949229 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecba1d-a628-41ff-a973-3931b17b8da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.949683 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecba1d-a628-41ff-a973-3931b17b8da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.950922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecba1d-a628-41ff-a973-3931b17b8da5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.953167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecba1d-a628-41ff-a973-3931b17b8da5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.959257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1314/2646] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:55.960636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecba1d-a628-41ff-a973-3931b17b8da5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:55.960773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:55.971069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b8a02-a4b8-457e-b044-62b8db76dbd6 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:55.976524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911ad4b-0f9b-4e1c-a8db-96f685a5075a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:55.977261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911ad4b-0f9b-4e1c-a8db-96f685a5075a admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:55.977639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911ad4b-0f9b-4e1c-a8db-96f685a5075a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:55.978007 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911ad4b-0f9b-4e1c-a8db-96f685a5075a admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:55.978794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911ad4b-0f9b-4e1c-a8db-96f685a5075a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:55.981345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911ad4b-0f9b-4e1c-a8db-96f685a5075a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.001828 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1333/2647] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:55 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:56.006498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecba1d-a628-41ff-a973-3931b17b8da5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.027788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1315/2648] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:55 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:56.029938 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911ad4b-0f9b-4e1c-a8db-96f685a5075a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.040269 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:56.095145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecba1d-a628-41ff-a973-3931b17b8da5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.106315 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911ad4b-0f9b-4e1c-a8db-96f685a5075a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.110999 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.111710 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.111986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.112254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.112957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.115083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.140321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1316/2649] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:56.140321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.140321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:56.151894 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7f20c-faf1-4fde-9541-307f50b6c489 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.156636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.157546 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.157772 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.158039 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] PATH_INFO: `/v3/projects/7a868997c83643c48fb634034a536749` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.159217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a32329-50fe-4339-a0b8-a0360a7a2413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.159356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a868997c83643c48fb634034a536749)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.160077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32329-50fe-4339-a0b8-a0360a7a2413 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.160432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32329-50fe-4339-a0b8-a0360a7a2413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.160704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a32329-50fe-4339-a0b8-a0360a7a2413 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.161177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.161400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a32329-50fe-4339-a0b8-a0360a7a2413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.163347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a32329-50fe-4339-a0b8-a0360a7a2413 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.186697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1334/2650] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:56.186697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a32329-50fe-4339-a0b8-a0360a7a2413 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.194497 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a32329-50fe-4339-a0b8-a0360a7a2413 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.199064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f916a-0fb2-4020-8e0d-bbc8a11e27f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.200061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f916a-0fb2-4020-8e0d-bbc8a11e27f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.200347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f916a-0fb2-4020-8e0d-bbc8a11e27f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.200617 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f916a-0fb2-4020-8e0d-bbc8a11e27f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.201337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f916a-0fb2-4020-8e0d-bbc8a11e27f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.202916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66f916a-0fb2-4020-8e0d-bbc8a11e27f9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.211258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a868997c83643c48fb634034a536749', 'request_id': 'req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:56.212824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1335/2651] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:56.213685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f916a-0fb2-4020-8e0d-bbc8a11e27f9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.219956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a868997c83643c48fb634034a536749', 'request_id': 'req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:56.223245 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f916a-0fb2-4020-8e0d-bbc8a11e27f9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.225905 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a868997c83643c48fb634034a536749', 'request_id': 'req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:56.238243 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] The token cache is being invalidate because project 7a868997c83643c48fb634034a536749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:50:56.238535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:56.239235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:50:56.241122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1317/2652] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:50:56 2022] DELETE /identity/v3/projects/7a868997c83643c48fb634034a536749 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:56.244368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.245927 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:56.259437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:56.280574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d28b5-143a-45ee-9307-86af39f98825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.281250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d28b5-143a-45ee-9307-86af39f98825 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.281533 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d28b5-143a-45ee-9307-86af39f98825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.281809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d28b5-143a-45ee-9307-86af39f98825 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.282548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d28b5-143a-45ee-9307-86af39f98825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.284175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d28b5-143a-45ee-9307-86af39f98825 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.293878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1336/2653] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:56.295092 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0c29-e349-4fd2-951a-0681f0078f6a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.295384 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0c29-e349-4fd2-951a-0681f0078f6a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.295686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0c29-e349-4fd2-951a-0681f0078f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.311392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dc4ed1-7a5a-438c-b84c-a3d74d03cb7e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.314598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-71ad0c29-e349-4fd2-951a-0681f0078f6a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:56.315966 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-71ad0c29-e349-4fd2-951a-0681f0078f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:56.316667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a84363f-e285-4da8-a076-f6612fae3841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.317336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84363f-e285-4da8-a076-f6612fae3841 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.317629 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84363f-e285-4da8-a076-f6612fae3841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.317895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a84363f-e285-4da8-a076-f6612fae3841 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.318658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84363f-e285-4da8-a076-f6612fae3841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.320471 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a84363f-e285-4da8-a076-f6612fae3841 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.324015 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1337/2654] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:56.325175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad0c29-e349-4fd2-951a-0681f0078f6a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.326425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-71ad0c29-e349-4fd2-951a-0681f0078f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:56.335410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1318/2655] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:56.337743 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3d8f-b908-467b-889e-595caaeb0aac None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.338037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3d8f-b908-467b-889e-595caaeb0aac None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.338197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad0c29-e349-4fd2-951a-0681f0078f6a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.338304 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa3d8f-b908-467b-889e-595caaeb0aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.342841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb9d5-b4b0-4275-a809-c886df0c9965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.343702 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb9d5-b4b0-4275-a809-c886df0c9965 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.343980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb9d5-b4b0-4275-a809-c886df0c9965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.344248 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ddb9d5-b4b0-4275-a809-c886df0c9965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.345006 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddb9d5-b4b0-4275-a809-c886df0c9965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.346565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ddb9d5-b4b0-4275-a809-c886df0c9965 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.356671 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1338/2656] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:56.357445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb9d5-b4b0-4275-a809-c886df0c9965 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.357576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-bdfa3d8f-b908-467b-889e-595caaeb0aac None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:56.359104 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-bdfa3d8f-b908-467b-889e-595caaeb0aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:56.367067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ddb9d5-b4b0-4275-a809-c886df0c9965 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.368439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1319/2657] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:56.369225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa3d8f-b908-467b-889e-595caaeb0aac None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.371591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371f1a-017a-4372-9006-ef7be4c6e340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.372489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371f1a-017a-4372-9006-ef7be4c6e340 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.372766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371f1a-017a-4372-9006-ef7be4c6e340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.373035 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7371f1a-017a-4372-9006-ef7be4c6e340 admin admin] PATH_INFO: `/v3/projects/30e2f681f7db48fbb2a8f5f808409c52/users/e35b6050a1934a3d9a76602056aacde9/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.378651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa3d8f-b908-467b-889e-595caaeb0aac None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.383250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd14762-ad61-4a4e-9b29-33fe155dc22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.384161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd14762-ad61-4a4e-9b29-33fe155dc22d admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.384424 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd14762-ad61-4a4e-9b29-33fe155dc22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.384741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd14762-ad61-4a4e-9b29-33fe155dc22d admin admin] PATH_INFO: `/v3/projects/f032d0be249e4d439f7f6d7e2f844427/users/d2cf8eaf65614dff9d120980f924f169/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.388140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371f1a-017a-4372-9006-ef7be4c6e340 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e2f681f7db48fbb2a8f5f808409c52, user_id=e35b6050a1934a3d9a76602056aacde9, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.390779 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7371f1a-017a-4372-9006-ef7be4c6e340 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.399187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:56.399348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd14762-ad61-4a4e-9b29-33fe155dc22d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f032d0be249e4d439f7f6d7e2f844427, user_id=d2cf8eaf65614dff9d120980f924f169, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.401907 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd14762-ad61-4a4e-9b29-33fe155dc22d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.407650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1339/2658] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:56 2022] PUT /identity/v3/projects/30e2f681f7db48fbb2a8f5f808409c52/users/e35b6050a1934a3d9a76602056aacde9/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:56.407650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371f1a-017a-4372-9006-ef7be4c6e340 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.427316 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1320/2659] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:56 2022] PUT /identity/v3/projects/f032d0be249e4d439f7f6d7e2f844427/users/d2cf8eaf65614dff9d120980f924f169/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:56.428701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac762d-37c6-4be6-ba29-7dc23f698ff6 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.428984 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac762d-37c6-4be6-ba29-7dc23f698ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.429256 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac762d-37c6-4be6-ba29-7dc23f698ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.460977 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-fdac762d-37c6-4be6-ba29-7dc23f698ff6 None None] MFA Rules not processed for user `e35b6050a1934a3d9a76602056aacde9`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:56.462190 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fdac762d-37c6-4be6-ba29-7dc23f698ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:56.469668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7371f1a-017a-4372-9006-ef7be4c6e340 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.527003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.527666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.527947 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.528217 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.528942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:50:56.529246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.530139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1321/2660] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:56.534202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.534327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013903-de02-46bf-a2ac-531ed7a2a82a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.534327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013903-de02-46bf-a2ac-531ed7a2a82a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.534327 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71013903-de02-46bf-a2ac-531ed7a2a82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.549184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1340/2661] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:50:56.549184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.549184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:56.565554 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-71013903-de02-46bf-a2ac-531ed7a2a82a None None] MFA Rules not processed for user `d2cf8eaf65614dff9d120980f924f169`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:56.566824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-71013903-de02-46bf-a2ac-531ed7a2a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:56.621909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:56.622170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6735fd04-8ddf-4743-b918-de657db73094 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.627997 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c67b96-047b-4b2c-87e7-80b47a8898d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.628653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c67b96-047b-4b2c-87e7-80b47a8898d4 service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.629315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c67b96-047b-4b2c-87e7-80b47a8898d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.629615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c67b96-047b-4b2c-87e7-80b47a8898d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.632780 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1322/2662] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:56.633686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71013903-de02-46bf-a2ac-531ed7a2a82a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.638184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c67b96-047b-4b2c-87e7-80b47a8898d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.639795 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c67b96-047b-4b2c-87e7-80b47a8898d4 service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.643914 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71013903-de02-46bf-a2ac-531ed7a2a82a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.648516 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520906e4-c307-48e6-888c-7180348c5392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.648926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1341/2663] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:56.649176 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520906e4-c307-48e6-888c-7180348c5392 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.649464 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520906e4-c307-48e6-888c-7180348c5392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.649729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c67b96-047b-4b2c-87e7-80b47a8898d4 service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.649844 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520906e4-c307-48e6-888c-7180348c5392 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.650485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520906e4-c307-48e6-888c-7180348c5392 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.652425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520906e4-c307-48e6-888c-7180348c5392 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.660994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c67b96-047b-4b2c-87e7-80b47a8898d4 service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.667018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56aad-b16e-4225-ad4b-cd2b9566dd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.667836 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56aad-b16e-4225-ad4b-cd2b9566dd66 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.668185 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56aad-b16e-4225-ad4b-cd2b9566dd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.668527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea56aad-b16e-4225-ad4b-cd2b9566dd66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.669296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea56aad-b16e-4225-ad4b-cd2b9566dd66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.671486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea56aad-b16e-4225-ad4b-cd2b9566dd66 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.684801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1323/2664] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:56.686319 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520906e4-c307-48e6-888c-7180348c5392 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.702391 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1342/2665] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:56.706051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56aad-b16e-4225-ad4b-cd2b9566dd66 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.711878 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:56.755247 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520906e4-c307-48e6-888c-7180348c5392 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.777133 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea56aad-b16e-4225-ad4b-cd2b9566dd66 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.782030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12c77-5ba0-4b9d-92c1-3972a32d7368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.782736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12c77-5ba0-4b9d-92c1-3972a32d7368 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.783025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12c77-5ba0-4b9d-92c1-3972a32d7368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.783297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12c77-5ba0-4b9d-92c1-3972a32d7368 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.784321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f12c77-5ba0-4b9d-92c1-3972a32d7368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.786296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f12c77-5ba0-4b9d-92c1-3972a32d7368 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.809355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1343/2666] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:50:56.813806 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12c77-5ba0-4b9d-92c1-3972a32d7368 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.820566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c0aa-be19-4905-a663-756a9b50d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.821196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c0aa-be19-4905-a663-756a9b50d806 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.821481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c0aa-be19-4905-a663-756a9b50d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.821759 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924c0aa-be19-4905-a663-756a9b50d806 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.822483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c0aa-be19-4905-a663-756a9b50d806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.824445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9924c0aa-be19-4905-a663-756a9b50d806 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.825869 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12c77-5ba0-4b9d-92c1-3972a32d7368 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.831823 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ab788-b74b-4088-8e30-529cdfcf799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.833218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ab788-b74b-4088-8e30-529cdfcf799c admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.833524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ab788-b74b-4088-8e30-529cdfcf799c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.834163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09ab788-b74b-4088-8e30-529cdfcf799c admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.835355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ab788-b74b-4088-8e30-529cdfcf799c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.837231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09ab788-b74b-4088-8e30-529cdfcf799c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.848283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1344/2667] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:50:56.849460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ab788-b74b-4088-8e30-529cdfcf799c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.851437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1324/2668] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:56.852378 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c0aa-be19-4905-a663-756a9b50d806 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.860156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09ab788-b74b-4088-8e30-529cdfcf799c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.862988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924c0aa-be19-4905-a663-756a9b50d806 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.865574 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ca64-ed0b-4699-b071-4a74d6ae3b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.866265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ca64-ed0b-4699-b071-4a74d6ae3b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.866569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ca64-ed0b-4699-b071-4a74d6ae3b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.866793 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45ca64-ed0b-4699-b071-4a74d6ae3b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.867567 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ca64-ed0b-4699-b071-4a74d6ae3b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.868165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde5a5-0dd8-488e-a715-165f01fdb958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.868948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde5a5-0dd8-488e-a715-165f01fdb958 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.869275 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c45ca64-ed0b-4699-b071-4a74d6ae3b99 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.869389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde5a5-0dd8-488e-a715-165f01fdb958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.869622 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabde5a5-0dd8-488e-a715-165f01fdb958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.870438 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabde5a5-0dd8-488e-a715-165f01fdb958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.872147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabde5a5-0dd8-488e-a715-165f01fdb958 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.881705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1345/2669] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:50:56.886520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ca64-ed0b-4699-b071-4a74d6ae3b99 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.887009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1325/2670] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:56.892770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde5a5-0dd8-488e-a715-165f01fdb958 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.898057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45ca64-ed0b-4699-b071-4a74d6ae3b99 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.903465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3ddd-21c8-465c-b3b9-764294d3780b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.903718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabde5a5-0dd8-488e-a715-165f01fdb958 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.904450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3ddd-21c8-465c-b3b9-764294d3780b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.904755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3ddd-21c8-465c-b3b9-764294d3780b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.905153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3ddd-21c8-465c-b3b9-764294d3780b admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.906038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd3ddd-21c8-465c-b3b9-764294d3780b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.907763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd3ddd-21c8-465c-b3b9-764294d3780b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.908963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7f542-969d-449f-9d05-f7577ebd07a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.910451 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7f542-969d-449f-9d05-f7577ebd07a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.910587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7f542-969d-449f-9d05-f7577ebd07a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.910810 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7f542-969d-449f-9d05-f7577ebd07a5 admin admin] PATH_INFO: `/v3/projects/ee183c71b78c4826bb5e0516b6291849/users/ee7e8270d04b4ae49557bf14c44891a3/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.919403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1346/2671] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:56.923399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3ddd-21c8-465c-b3b9-764294d3780b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:56.935625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3ddd-21c8-465c-b3b9-764294d3780b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:56.938003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7f542-969d-449f-9d05-f7577ebd07a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee183c71b78c4826bb5e0516b6291849, user_id=ee7e8270d04b4ae49557bf14c44891a3, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.941228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7a66c-e969-4f25-ba24-01578842748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:56.941383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7f542-969d-449f-9d05-f7577ebd07a5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.942456 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7a66c-e969-4f25-ba24-01578842748e admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.942802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7a66c-e969-4f25-ba24-01578842748e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.943136 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7a66c-e969-4f25-ba24-01578842748e admin admin] PATH_INFO: `/v3/projects/c013c968bc084e118e139faeecb8bd4b/users/1f8ed7ba71da45e5af9053a00df26618/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.957881 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1326/2672] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:56 2022] PUT /identity/v3/projects/ee183c71b78c4826bb5e0516b6291849/users/ee7e8270d04b4ae49557bf14c44891a3/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:56.968657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f3ef5-4298-442d-a634-4bfe829e2ffd None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:56.969559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f3ef5-4298-442d-a634-4bfe829e2ffd None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:56.970066 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f3ef5-4298-442d-a634-4bfe829e2ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:56.974372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7a66c-e969-4f25-ba24-01578842748e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c013c968bc084e118e139faeecb8bd4b, user_id=1f8ed7ba71da45e5af9053a00df26618, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:56.977443 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7a66c-e969-4f25-ba24-01578842748e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:56.999643 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1347/2673] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:56 2022] PUT /identity/v3/projects/c013c968bc084e118e139faeecb8bd4b/users/1f8ed7ba71da45e5af9053a00df26618/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:57.007504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c224-87b8-4274-9db7-4cefc13b881f None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.007826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c224-87b8-4274-9db7-4cefc13b881f None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.008101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e3c224-87b8-4274-9db7-4cefc13b881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.020653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-cf8f3ef5-4298-442d-a634-4bfe829e2ffd None None] MFA Rules not processed for user `ee7e8270d04b4ae49557bf14c44891a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:57.021993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-cf8f3ef5-4298-442d-a634-4bfe829e2ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:57.039705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d7e3c224-87b8-4274-9db7-4cefc13b881f None None] MFA Rules not processed for user `1f8ed7ba71da45e5af9053a00df26618`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:57.041629 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d7e3c224-87b8-4274-9db7-4cefc13b881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:57.050861 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:57.097151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1327/2674] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:57.101677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f3ef5-4298-442d-a634-4bfe829e2ffd None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.116707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1348/2675] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:57.127427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3c224-87b8-4274-9db7-4cefc13b881f None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.128862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d7e3c224-87b8-4274-9db7-4cefc13b881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:57.155581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:57.162641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f3ef5-4298-442d-a634-4bfe829e2ffd None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.167667 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec172f1-6d93-4620-abe2-e3748b4a8849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.168338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec172f1-6d93-4620-abe2-e3748b4a8849 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.168615 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec172f1-6d93-4620-abe2-e3748b4a8849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.168885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec172f1-6d93-4620-abe2-e3748b4a8849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.169573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec172f1-6d93-4620-abe2-e3748b4a8849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.171636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec172f1-6d93-4620-abe2-e3748b4a8849 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.187381 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e3c224-87b8-4274-9db7-4cefc13b881f None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.191328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de76a-7f77-42f0-b056-727cc1b1b1e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.192051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de76a-7f77-42f0-b056-727cc1b1b1e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.192322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de76a-7f77-42f0-b056-727cc1b1b1e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.192594 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4de76a-7f77-42f0-b056-727cc1b1b1e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.197983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1328/2676] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:50:57 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:57.202965 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec172f1-6d93-4620-abe2-e3748b4a8849 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.204227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4de76a-7f77-42f0-b056-727cc1b1b1e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.205798 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4de76a-7f77-42f0-b056-727cc1b1b1e2 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.215856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1349/2677] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:50:57.266385 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec172f1-6d93-4620-abe2-e3748b4a8849 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.271691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138dd3-a43b-48ba-b496-1ae3a17185a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.272392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dd3-a43b-48ba-b496-1ae3a17185a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.272675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dd3-a43b-48ba-b496-1ae3a17185a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.272953 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95138dd3-a43b-48ba-b496-1ae3a17185a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.273651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95138dd3-a43b-48ba-b496-1ae3a17185a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.275569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95138dd3-a43b-48ba-b496-1ae3a17185a1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.300372 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1329/2678] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:50:57 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:50:57.301822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de76a-7f77-42f0-b056-727cc1b1b1e2 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.312877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4de76a-7f77-42f0-b056-727cc1b1b1e2 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.317647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d1f8-701c-41d9-8e87-910e3c11c110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.318425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d1f8-701c-41d9-8e87-910e3c11c110 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.319039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d1f8-701c-41d9-8e87-910e3c11c110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.319039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6d1f8-701c-41d9-8e87-910e3c11c110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.319760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d1f8-701c-41d9-8e87-910e3c11c110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.321385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6d1f8-701c-41d9-8e87-910e3c11c110 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.331849 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1350/2679] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:57.336078 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138dd3-a43b-48ba-b496-1ae3a17185a1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.346641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95138dd3-a43b-48ba-b496-1ae3a17185a1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.352125 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcea67-8dce-4196-a4e3-d7cd8f37af5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.353000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcea67-8dce-4196-a4e3-d7cd8f37af5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.353283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcea67-8dce-4196-a4e3-d7cd8f37af5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.353684 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fcea67-8dce-4196-a4e3-d7cd8f37af5f admin admin] PATH_INFO: `/v3/projects/e444c2ab45af454eacc782503aa6ec8b/users/cb8c8b4272c548a48202be4d82588b99/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.371392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcea67-8dce-4196-a4e3-d7cd8f37af5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e444c2ab45af454eacc782503aa6ec8b, user_id=cb8c8b4272c548a48202be4d82588b99, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.374221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fcea67-8dce-4196-a4e3-d7cd8f37af5f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.388189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1330/2680] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:57 2022] PUT /identity/v3/projects/e444c2ab45af454eacc782503aa6ec8b/users/cb8c8b4272c548a48202be4d82588b99/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:50:57.392310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d1f8-701c-41d9-8e87-910e3c11c110 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.402461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6d1f8-701c-41d9-8e87-910e3c11c110 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.460170 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af52ba2-68f4-4212-8c38-4ec7fd75a857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.460991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af52ba2-68f4-4212-8c38-4ec7fd75a857 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.461415 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af52ba2-68f4-4212-8c38-4ec7fd75a857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.461822 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af52ba2-68f4-4212-8c38-4ec7fd75a857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.471178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af52ba2-68f4-4212-8c38-4ec7fd75a857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.471178 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af52ba2-68f4-4212-8c38-4ec7fd75a857 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.481398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1351/2681] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:50:57.485967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcea67-8dce-4196-a4e3-d7cd8f37af5f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.498687 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fcea67-8dce-4196-a4e3-d7cd8f37af5f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.505062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc767338-ae70-41dc-9e9f-33eef5db17e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.506283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767338-ae70-41dc-9e9f-33eef5db17e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.506621 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767338-ae70-41dc-9e9f-33eef5db17e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.506973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc767338-ae70-41dc-9e9f-33eef5db17e4 admin admin] PATH_INFO: `/v3/projects/e444c2ab45af454eacc782503aa6ec8b/users/cb8c8b4272c548a48202be4d82588b99/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.509114 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc767338-ae70-41dc-9e9f-33eef5db17e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e444c2ab45af454eacc782503aa6ec8b, user_id=cb8c8b4272c548a48202be4d82588b99, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.511807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc767338-ae70-41dc-9e9f-33eef5db17e4 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.534964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1331/2682] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:50:57 2022] PUT /identity/v3/projects/e444c2ab45af454eacc782503aa6ec8b/users/cb8c8b4272c548a48202be4d82588b99/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:50:57.546720 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9934322-71f5-44f8-b03e-6f25a8ea3634 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.547007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9934322-71f5-44f8-b03e-6f25a8ea3634 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.547280 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9934322-71f5-44f8-b03e-6f25a8ea3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.577775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a9934322-71f5-44f8-b03e-6f25a8ea3634 None None] MFA Rules not processed for user `cb8c8b4272c548a48202be4d82588b99`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:50:57.579107 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a9934322-71f5-44f8-b03e-6f25a8ea3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:57.651055 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1352/2683] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:50:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:50:57.663768 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc767338-ae70-41dc-9e9f-33eef5db17e4 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.668650 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:57.723214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc767338-ae70-41dc-9e9f-33eef5db17e4 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.727971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4ca78-9b18-4e21-ab4e-21b04efd5e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.728660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4ca78-9b18-4e21-ab4e-21b04efd5e66 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.728946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4ca78-9b18-4e21-ab4e-21b04efd5e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.729221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4ca78-9b18-4e21-ab4e-21b04efd5e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.739840 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4ca78-9b18-4e21-ab4e-21b04efd5e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.741394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4ca78-9b18-4e21-ab4e-21b04efd5e66 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.751578 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1332/2684] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:50:57.794156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9934322-71f5-44f8-b03e-6f25a8ea3634 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:50:57.795782 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a9934322-71f5-44f8-b03e-6f25a8ea3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:50:57.811398 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9934322-71f5-44f8-b03e-6f25a8ea3634 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:50:57.816067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8845f-e172-49d5-811b-f4539a8eb147 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:50:57.816777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8845f-e172-49d5-811b-f4539a8eb147 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:50:57.817064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8845f-e172-49d5-811b-f4539a8eb147 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:50:57.817343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8845f-e172-49d5-811b-f4539a8eb147 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:50:57.853591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:50:57.880406 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8845f-e172-49d5-811b-f4539a8eb147 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:50:57.881917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8845f-e172-49d5-811b-f4539a8eb147 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:50:57.892655 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1353/2685] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:50:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:00.847250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4ca78-9b18-4e21-ab4e-21b04efd5e66 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:00.918371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4ca78-9b18-4e21-ab4e-21b04efd5e66 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:00.923847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:00.924830 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:00.925127 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:00.925440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] PATH_INFO: `/v3/users/d2cf8eaf65614dff9d120980f924f169` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:00.927083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2cf8eaf65614dff9d120980f924f169)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:00.929389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:00.987737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2cf8eaf65614dff9d120980f924f169'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.003383 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2cf8eaf65614dff9d120980f924f169'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.005308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2cf8eaf65614dff9d120980f924f169'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.016291 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2cf8eaf65614dff9d120980f924f169'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.030775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2cf8eaf65614dff9d120980f924f169'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.037136 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1333/2686] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:00 2022] DELETE /identity/v3/users/d2cf8eaf65614dff9d120980f924f169 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:01.041833 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97ae1a-4bd7-4e71-9be2-f9d679edb1db None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:01.042313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97ae1a-4bd7-4e71-9be2-f9d679edb1db None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:01.042428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97ae1a-4bd7-4e71-9be2-f9d679edb1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:01.060080 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8e97ae1a-4bd7-4e71-9be2-f9d679edb1db None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:01.061376 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8e97ae1a-4bd7-4e71-9be2-f9d679edb1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:01.126922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1354/2687] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:01.140149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:01.141688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:01.175337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:01.206592 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da70d5-e1f8-4adb-a22e-f927711cde3f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:01.210241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10196-e804-4c5f-8a8b-4cfa997ac2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:01.212049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10196-e804-4c5f-8a8b-4cfa997ac2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:01.212344 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10196-e804-4c5f-8a8b-4cfa997ac2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:01.212620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd10196-e804-4c5f-8a8b-4cfa997ac2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:01.221724 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10196-e804-4c5f-8a8b-4cfa997ac2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:01.223175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd10196-e804-4c5f-8a8b-4cfa997ac2a0 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:01.232994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1334/2688] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:01.518316 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97ae1a-4bd7-4e71-9be2-f9d679edb1db None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:01.520071 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8e97ae1a-4bd7-4e71-9be2-f9d679edb1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:01.534357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97ae1a-4bd7-4e71-9be2-f9d679edb1db None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:01.541148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:01.542108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:01.542440 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:01.542752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] PATH_INFO: `/v3/projects/f032d0be249e4d439f7f6d7e2f844427` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:01.544527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f032d0be249e4d439f7f6d7e2f844427)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:01.546746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:01.597816 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f032d0be249e4d439f7f6d7e2f844427', 'request_id': 'req-c88df129-745a-4006-9577-936874e9e4ae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.604906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f032d0be249e4d439f7f6d7e2f844427', 'request_id': 'req-c88df129-745a-4006-9577-936874e9e4ae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.612475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f032d0be249e4d439f7f6d7e2f844427', 'request_id': 'req-c88df129-745a-4006-9577-936874e9e4ae'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.623314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] The token cache is being invalidate because project f032d0be249e4d439f7f6d7e2f844427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:01.623619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.624293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.625983 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1355/2689] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:01 2022] DELETE /identity/v3/projects/f032d0be249e4d439f7f6d7e2f844427 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:01.631389 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10196-e804-4c5f-8a8b-4cfa997ac2a0 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:01.643106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd10196-e804-4c5f-8a8b-4cfa997ac2a0 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:01.709961 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:01.710885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:01.711220 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:01.711558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] PATH_INFO: `/v3/users/ee7e8270d04b4ae49557bf14c44891a3` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:01.713070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7e8270d04b4ae49557bf14c44891a3)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:01.715297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:01.767037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7e8270d04b4ae49557bf14c44891a3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.774528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7e8270d04b4ae49557bf14c44891a3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.775145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7e8270d04b4ae49557bf14c44891a3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.782154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7e8270d04b4ae49557bf14c44891a3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.794799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7e8270d04b4ae49557bf14c44891a3'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:01.801402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1335/2690] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:01 2022] DELETE /identity/v3/users/ee7e8270d04b4ae49557bf14c44891a3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:01.967074 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:01.970202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:01.985747 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88df129-745a-4006-9577-936874e9e4ae admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:02.048988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:02.049933 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:02.050212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:02.050484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] PATH_INFO: `/v3/users/e35b6050a1934a3d9a76602056aacde9` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:02.051882 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e35b6050a1934a3d9a76602056aacde9)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:02.053805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:02.055436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:02.103150 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e35b6050a1934a3d9a76602056aacde9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.103879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e35b6050a1934a3d9a76602056aacde9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.104558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:02.106474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:02.113297 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e35b6050a1934a3d9a76602056aacde9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.123090 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e35b6050a1934a3d9a76602056aacde9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.124228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4f75783e-ab2c-4d7a-b01c-212475417de7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e35b6050a1934a3d9a76602056aacde9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.125148 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73daa2-d5b8-4cd5-9663-68188c5073bd admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:02.130024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:02.130818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:02.131084 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:02.131357 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] PATH_INFO: `/v3/projects/ee183c71b78c4826bb5e0516b6291849` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:02.132595 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee183c71b78c4826bb5e0516b6291849)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:02.134559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:02.148211 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1356/2691] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:01 2022] DELETE /identity/v3/users/e35b6050a1934a3d9a76602056aacde9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:02.152696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1c94-ae51-47e1-a731-fbffa1974baa None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:02.153061 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1c94-ae51-47e1-a731-fbffa1974baa None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:02.153405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b1c94-ae51-47e1-a731-fbffa1974baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:02.172731 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-606b1c94-ae51-47e1-a731-fbffa1974baa None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:02.174486 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-606b1c94-ae51-47e1-a731-fbffa1974baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:02.186214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:02.194801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee183c71b78c4826bb5e0516b6291849', 'request_id': 'req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.207237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee183c71b78c4826bb5e0516b6291849', 'request_id': 'req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.216615 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee183c71b78c4826bb5e0516b6291849', 'request_id': 'req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.231037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] The token cache is being invalidate because project ee183c71b78c4826bb5e0516b6291849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:02.231474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.232234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.233881 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1336/2692] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:02 2022] DELETE /identity/v3/projects/ee183c71b78c4826bb5e0516b6291849 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:02.238086 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:02.240262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:02.252625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1357/2693] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:02.263291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b1c94-ae51-47e1-a731-fbffa1974baa None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:02.263538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-606b1c94-ae51-47e1-a731-fbffa1974baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:02.325269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f81d3-f16a-4016-a672-dbaf5bcd1d1d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:02.330501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:02.331423 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:02.331859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:02.332014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] PATH_INFO: `/v3/users/cb8c8b4272c548a48202be4d82588b99` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:02.332140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b1c94-ae51-47e1-a731-fbffa1974baa None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:02.333449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8c8b4272c548a48202be4d82588b99)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:02.335370 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:02.335712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:02.336487 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:02.336764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:02.337041 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:02.349351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:02.350898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:02.368184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1358/2694] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:51:02.398859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8c8b4272c548a48202be4d82588b99'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.408596 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8c8b4272c548a48202be4d82588b99'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.409278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8c8b4272c548a48202be4d82588b99'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.419405 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8c8b4272c548a48202be4d82588b99'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.435676 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8c8b4272c548a48202be4d82588b99'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.442418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1337/2695] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:02 2022] DELETE /identity/v3/users/cb8c8b4272c548a48202be4d82588b99 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:02.722232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:02.724056 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:02.749087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630fcd9d-e804-479a-a68c-e45494f0f119 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:02.784362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:02.817283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:02.818888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:02.837176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:02.838115 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:02.838465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:02.838780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] PATH_INFO: `/v3/projects/30e2f681f7db48fbb2a8f5f808409c52` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:02.840182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e2f681f7db48fbb2a8f5f808409c52)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:02.842154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:02.897090 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:02.899754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e2f681f7db48fbb2a8f5f808409c52', 'request_id': 'req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.908184 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e2f681f7db48fbb2a8f5f808409c52', 'request_id': 'req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.917888 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e2f681f7db48fbb2a8f5f808409c52', 'request_id': 'req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.918141 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4e09f-76ae-4fea-9f56-1ae68ba0b9be admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:02.935834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] The token cache is being invalidate because project 30e2f681f7db48fbb2a8f5f808409c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:02.935834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.935834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ce37e5f4-4a4c-424b-a03b-eb4d57b52dd5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:02.935834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1359/2696] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:02 2022] DELETE /identity/v3/projects/30e2f681f7db48fbb2a8f5f808409c52 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:02.940201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38786fc0-116d-41c0-b161-97924cdfc919 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:02.940498 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38786fc0-116d-41c0-b161-97924cdfc919 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:02.940817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38786fc0-116d-41c0-b161-97924cdfc919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:02.961965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-38786fc0-116d-41c0-b161-97924cdfc919 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:02.963538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-38786fc0-116d-41c0-b161-97924cdfc919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:02.986818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:02.987677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:02.987962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:02.988239 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] PATH_INFO: `/v3/projects/e444c2ab45af454eacc782503aa6ec8b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:02.989556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e444c2ab45af454eacc782503aa6ec8b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:02.991715 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.037687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1360/2697] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:03.046466 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdb576-1873-43ea-8cb0-3cfd0fc2573b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.046759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdb576-1873-43ea-8cb0-3cfd0fc2573b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.047040 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdb576-1873-43ea-8cb0-3cfd0fc2573b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.050939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e444c2ab45af454eacc782503aa6ec8b', 'request_id': 'req-a368640e-9f6c-4275-81bf-547bbd938b59'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:03.060076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e444c2ab45af454eacc782503aa6ec8b', 'request_id': 'req-a368640e-9f6c-4275-81bf-547bbd938b59'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:03.065965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a3bdb576-1873-43ea-8cb0-3cfd0fc2573b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:03.066463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e444c2ab45af454eacc782503aa6ec8b', 'request_id': 'req-a368640e-9f6c-4275-81bf-547bbd938b59'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:03.067250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a3bdb576-1873-43ea-8cb0-3cfd0fc2573b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:03.078677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] The token cache is being invalidate because project e444c2ab45af454eacc782503aa6ec8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:03.079038 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:03.079826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a368640e-9f6c-4275-81bf-547bbd938b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:03.081665 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1338/2698] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:02 2022] DELETE /identity/v3/projects/e444c2ab45af454eacc782503aa6ec8b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:03.087725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f142c14-f3a5-4961-bdaa-af6ffdcd2b70 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.088052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f142c14-f3a5-4961-bdaa-af6ffdcd2b70 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.088312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f142c14-f3a5-4961-bdaa-af6ffdcd2b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.107092 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-6f142c14-f3a5-4961-bdaa-af6ffdcd2b70 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:03.108377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-6f142c14-f3a5-4961-bdaa-af6ffdcd2b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:03.116749 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:03.134241 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1361/2699] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:03.138753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdb576-1873-43ea-8cb0-3cfd0fc2573b None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.147946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdb576-1873-43ea-8cb0-3cfd0fc2573b None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.152961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.153615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.153895 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.154167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.154893 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:03.155194 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.156820 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.168867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1339/2700] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:03.171386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1362/2701] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:51:03.173329 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.177214 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272961e2-64e3-4710-8f63-d41f9b9ab762 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.177506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272961e2-64e3-4710-8f63-d41f9b9ab762 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.177788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272961e2-64e3-4710-8f63-d41f9b9ab762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.183400 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aec9a9d-f938-4475-ad58-901601413447 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.188119 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5462-153c-45a4-922e-c0cf6373e189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.188789 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5462-153c-45a4-922e-c0cf6373e189 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.189069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5462-153c-45a4-922e-c0cf6373e189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.189340 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac5462-153c-45a4-922e-c0cf6373e189 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.190023 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5462-153c-45a4-922e-c0cf6373e189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.191938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac5462-153c-45a4-922e-c0cf6373e189 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.196625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-272961e2-64e3-4710-8f63-d41f9b9ab762 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:03.197866 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-272961e2-64e3-4710-8f63-d41f9b9ab762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:03.206576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1340/2702] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:03.210990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272961e2-64e3-4710-8f63-d41f9b9ab762 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.223195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1363/2703] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:03.223374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272961e2-64e3-4710-8f63-d41f9b9ab762 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.224198 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5462-153c-45a4-922e-c0cf6373e189 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.240108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:03.285960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.286695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.286983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.287186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac5462-153c-45a4-922e-c0cf6373e189 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.287440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.288149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:03.288488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.291270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.292045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e24b-bd66-495b-9ef5-44777c70d0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.292732 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e24b-bd66-495b-9ef5-44777c70d0a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.293012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e24b-bd66-495b-9ef5-44777c70d0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.293288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e24b-bd66-495b-9ef5-44777c70d0a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.294014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1e24b-bd66-495b-9ef5-44777c70d0a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.295999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1e24b-bd66-495b-9ef5-44777c70d0a6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.303473 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1341/2704] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:51:03.308683 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.316278 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1364/2705] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:03.318645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59f31c-6d85-461a-a8a4-fe7a90e77ec4 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.320458 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e24b-bd66-495b-9ef5-44777c70d0a6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.323799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666c17-5fec-41ef-97cd-f25f6aee3adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.324452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666c17-5fec-41ef-97cd-f25f6aee3adf admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.324763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666c17-5fec-41ef-97cd-f25f6aee3adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.325322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80666c17-5fec-41ef-97cd-f25f6aee3adf admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.326050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80666c17-5fec-41ef-97cd-f25f6aee3adf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.327986 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80666c17-5fec-41ef-97cd-f25f6aee3adf admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.331634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e24b-bd66-495b-9ef5-44777c70d0a6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.337101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ecb97-8722-4048-a619-77b9a34f699f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.337901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ecb97-8722-4048-a619-77b9a34f699f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.338330 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ecb97-8722-4048-a619-77b9a34f699f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.338689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ecb97-8722-4048-a619-77b9a34f699f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.339763 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ecb97-8722-4048-a619-77b9a34f699f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.341659 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ecb97-8722-4048-a619-77b9a34f699f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.353839 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1365/2706] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:03.355505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1342/2707] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:03.358002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ecb97-8722-4048-a619-77b9a34f699f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.359398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666c17-5fec-41ef-97cd-f25f6aee3adf admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.368992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ecb97-8722-4048-a619-77b9a34f699f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.423795 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80666c17-5fec-41ef-97cd-f25f6aee3adf admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.428712 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5f790-0732-44cb-b3e4-9f628219c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.429396 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f790-0732-44cb-b3e4-9f628219c0fb admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.429680 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f790-0732-44cb-b3e4-9f628219c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.429957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f790-0732-44cb-b3e4-9f628219c0fb admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.430760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5f790-0732-44cb-b3e4-9f628219c0fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.431176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926f2cf-cc0d-4ee7-9f48-7113fcf3b8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.432034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926f2cf-cc0d-4ee7-9f48-7113fcf3b8cc admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.432383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926f2cf-cc0d-4ee7-9f48-7113fcf3b8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.432703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926f2cf-cc0d-4ee7-9f48-7113fcf3b8cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.432827 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e5f790-0732-44cb-b3e4-9f628219c0fb admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.433588 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926f2cf-cc0d-4ee7-9f48-7113fcf3b8cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.435515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926f2cf-cc0d-4ee7-9f48-7113fcf3b8cc admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.446889 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1366/2708] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:03.451930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926f2cf-cc0d-4ee7-9f48-7113fcf3b8cc admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.459222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1343/2709] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:03.463384 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5f790-0732-44cb-b3e4-9f628219c0fb admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.465625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926f2cf-cc0d-4ee7-9f48-7113fcf3b8cc admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.470980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392ce4f2-aa58-4360-a05e-3b06a9588562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.471949 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ce4f2-aa58-4360-a05e-3b06a9588562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.472228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ce4f2-aa58-4360-a05e-3b06a9588562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.472506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ce4f2-aa58-4360-a05e-3b06a9588562 admin admin] PATH_INFO: `/v3/projects/a395bd26656749c6b387d281e4884785/users/f6ebb048d6064c7f8867ee10e5967a94/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.474215 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5f790-0732-44cb-b3e4-9f628219c0fb admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.480082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd5f9-7136-4d26-b683-9339b827fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.481099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd5f9-7136-4d26-b683-9339b827fe36 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.481488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd5f9-7136-4d26-b683-9339b827fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.481802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcfd5f9-7136-4d26-b683-9339b827fe36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.482771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfd5f9-7136-4d26-b683-9339b827fe36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.484441 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcfd5f9-7136-4d26-b683-9339b827fe36 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.488571 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ce4f2-aa58-4360-a05e-3b06a9588562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a395bd26656749c6b387d281e4884785, user_id=f6ebb048d6064c7f8867ee10e5967a94, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.491250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392ce4f2-aa58-4360-a05e-3b06a9588562 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.498326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1344/2710] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:03.499788 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd5f9-7136-4d26-b683-9339b827fe36 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.512555 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1367/2711] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:03 2022] PUT /identity/v3/projects/a395bd26656749c6b387d281e4884785/users/f6ebb048d6064c7f8867ee10e5967a94/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:03.521117 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcfd5f9-7136-4d26-b683-9339b827fe36 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.522774 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a6a31-83af-46d6-b36d-8b25fea83dd6 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.523132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a6a31-83af-46d6-b36d-8b25fea83dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.523354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a6a31-83af-46d6-b36d-8b25fea83dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.544113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:03.554578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-aa9a6a31-83af-46d6-b36d-8b25fea83dd6 None None] MFA Rules not processed for user `f6ebb048d6064c7f8867ee10e5967a94`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:03.555994 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-aa9a6a31-83af-46d6-b36d-8b25fea83dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:03.583520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7e6b7-aa10-4204-a24e-daabf6a006fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.584371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7e6b7-aa10-4204-a24e-daabf6a006fb admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.584663 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7e6b7-aa10-4204-a24e-daabf6a006fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.584942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7e6b7-aa10-4204-a24e-daabf6a006fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.585670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7e6b7-aa10-4204-a24e-daabf6a006fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.587992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7e6b7-aa10-4204-a24e-daabf6a006fb admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.599643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1345/2712] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:03.602555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7e6b7-aa10-4204-a24e-daabf6a006fb admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.612158 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7e6b7-aa10-4204-a24e-daabf6a006fb admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.617331 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0874a56-c1fa-4406-aa7e-12d8706f1344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.618235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874a56-c1fa-4406-aa7e-12d8706f1344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.618517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874a56-c1fa-4406-aa7e-12d8706f1344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.618939 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874a56-c1fa-4406-aa7e-12d8706f1344 admin admin] PATH_INFO: `/v3/projects/64dfc797ce7042249b2dc3e4b9579197/users/7d55ac56dcf84e82b61ab80bf32cffa5/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.621253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:03.625371 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1368/2713] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:03.629802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a6a31-83af-46d6-b36d-8b25fea83dd6 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.635807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0874a56-c1fa-4406-aa7e-12d8706f1344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64dfc797ce7042249b2dc3e4b9579197, user_id=7d55ac56dcf84e82b61ab80bf32cffa5, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.638447 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0874a56-c1fa-4406-aa7e-12d8706f1344 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.640493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a6a31-83af-46d6-b36d-8b25fea83dd6 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.645925 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffcafb-8000-4945-8a31-39202a02a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.646930 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffcafb-8000-4945-8a31-39202a02a105 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.647308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffcafb-8000-4945-8a31-39202a02a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.647590 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ffcafb-8000-4945-8a31-39202a02a105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.648345 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffcafb-8000-4945-8a31-39202a02a105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.650313 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ffcafb-8000-4945-8a31-39202a02a105 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.657274 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1346/2714] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:03 2022] PUT /identity/v3/projects/64dfc797ce7042249b2dc3e4b9579197/users/7d55ac56dcf84e82b61ab80bf32cffa5/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:03.668975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d4f2-c9b6-4519-a727-625307cdbe6d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.669262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d4f2-c9b6-4519-a727-625307cdbe6d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.669542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8d4f2-c9b6-4519-a727-625307cdbe6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.688100 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1369/2715] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:03.689706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffcafb-8000-4945-8a31-39202a02a105 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.696083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-c8c8d4f2-c9b6-4519-a727-625307cdbe6d None None] MFA Rules not processed for user `7d55ac56dcf84e82b61ab80bf32cffa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:03.697276 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-c8c8d4f2-c9b6-4519-a727-625307cdbe6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:03.755224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ffcafb-8000-4945-8a31-39202a02a105 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.760429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc39769-4a59-42f1-be96-0217dc66a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.761121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc39769-4a59-42f1-be96-0217dc66a031 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.761407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc39769-4a59-42f1-be96-0217dc66a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.761696 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc39769-4a59-42f1-be96-0217dc66a031 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.762403 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1347/2716] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:03.762508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc39769-4a59-42f1-be96-0217dc66a031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.764439 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc39769-4a59-42f1-be96-0217dc66a031 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.766969 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8d4f2-c9b6-4519-a727-625307cdbe6d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.778360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8d4f2-c9b6-4519-a727-625307cdbe6d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.783360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21cea4-23bd-43d2-9023-dcee1ed6dda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.784161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21cea4-23bd-43d2-9023-dcee1ed6dda0 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.784542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21cea4-23bd-43d2-9023-dcee1ed6dda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.784932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21cea4-23bd-43d2-9023-dcee1ed6dda0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.785716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21cea4-23bd-43d2-9023-dcee1ed6dda0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.785972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1370/2717] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:03.787908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21cea4-23bd-43d2-9023-dcee1ed6dda0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.789979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc39769-4a59-42f1-be96-0217dc66a031 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.799679 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc39769-4a59-42f1-be96-0217dc66a031 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.804578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df67770-e39c-4c55-9fa0-6ca3ca38bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.805364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67770-e39c-4c55-9fa0-6ca3ca38bb41 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.805803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67770-e39c-4c55-9fa0-6ca3ca38bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.805962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df67770-e39c-4c55-9fa0-6ca3ca38bb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.806581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df67770-e39c-4c55-9fa0-6ca3ca38bb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.808214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df67770-e39c-4c55-9fa0-6ca3ca38bb41 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.819398 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1348/2718] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:03.819565 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1371/2719] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:03.820510 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21cea4-23bd-43d2-9023-dcee1ed6dda0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.822577 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df67770-e39c-4c55-9fa0-6ca3ca38bb41 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.832938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df67770-e39c-4c55-9fa0-6ca3ca38bb41 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.884847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:03.887420 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21cea4-23bd-43d2-9023-dcee1ed6dda0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.892494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0162-6820-48bb-95d4-154401bd8c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.892967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b831e9-522a-44a8-b92c-03edae9c45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.893628 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0162-6820-48bb-95d4-154401bd8c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.893741 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b831e9-522a-44a8-b92c-03edae9c45c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.893970 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0162-6820-48bb-95d4-154401bd8c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.894071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b831e9-522a-44a8-b92c-03edae9c45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.894360 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b831e9-522a-44a8-b92c-03edae9c45c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.894735 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c0162-6820-48bb-95d4-154401bd8c92 admin admin] PATH_INFO: `/v3/projects/f8def39d8d664b7d808dde309c7cde98/users/f4ba0c48a67842aa91fa480a3a62b4a2/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.895077 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b831e9-522a-44a8-b92c-03edae9c45c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.897147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b831e9-522a-44a8-b92c-03edae9c45c8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.910215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0162-6820-48bb-95d4-154401bd8c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8def39d8d664b7d808dde309c7cde98, user_id=f4ba0c48a67842aa91fa480a3a62b4a2, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.913020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c0162-6820-48bb-95d4-154401bd8c92 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:03.918519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1349/2720] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:03 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:03.922631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b831e9-522a-44a8-b92c-03edae9c45c8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.926358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1372/2721] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:03 2022] PUT /identity/v3/projects/f8def39d8d664b7d808dde309c7cde98/users/f4ba0c48a67842aa91fa480a3a62b4a2/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:03.930368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0162-6820-48bb-95d4-154401bd8c92 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:03.933271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b831e9-522a-44a8-b92c-03edae9c45c8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.973954 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:03.991875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c0162-6820-48bb-95d4-154401bd8c92 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:03.995227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf77ea-ffc1-4935-a114-1d72e1b8ae9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.995994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf77ea-ffc1-4935-a114-1d72e1b8ae9c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.996282 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf77ea-ffc1-4935-a114-1d72e1b8ae9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.996561 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cf77ea-ffc1-4935-a114-1d72e1b8ae9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.996813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02fb1-f413-4c39-a46b-35a8a22db30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:03.997345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf77ea-ffc1-4935-a114-1d72e1b8ae9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.997465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02fb1-f413-4c39-a46b-35a8a22db30a admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:03.997743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02fb1-f413-4c39-a46b-35a8a22db30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:03.998016 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e02fb1-f413-4c39-a46b-35a8a22db30a admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:03.998743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e02fb1-f413-4c39-a46b-35a8a22db30a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:03.999066 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cf77ea-ffc1-4935-a114-1d72e1b8ae9c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.000372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e02fb1-f413-4c39-a46b-35a8a22db30a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.010280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1350/2722] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:04.013892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1373/2723] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:03 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:04.014821 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02fb1-f413-4c39-a46b-35a8a22db30a admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.014946 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf77ea-ffc1-4935-a114-1d72e1b8ae9c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.025309 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e02fb1-f413-4c39-a46b-35a8a22db30a admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.025494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cf77ea-ffc1-4935-a114-1d72e1b8ae9c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.029941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347500f3-1d08-4bd5-914c-978bd5064666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.030509 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab23c48-002d-4556-a8e8-0bb05b8e4c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.030871 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347500f3-1d08-4bd5-914c-978bd5064666 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.031156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347500f3-1d08-4bd5-914c-978bd5064666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.031449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23c48-002d-4556-a8e8-0bb05b8e4c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.031566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347500f3-1d08-4bd5-914c-978bd5064666 admin admin] PATH_INFO: `/v3/projects/4f45b367d650453c98670298fdf24b7c/users/1d91cd00d4814a1c95ae72c5422be250/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.031874 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23c48-002d-4556-a8e8-0bb05b8e4c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.032134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab23c48-002d-4556-a8e8-0bb05b8e4c7f admin admin] PATH_INFO: `/v3/projects/f8def39d8d664b7d808dde309c7cde98/users/f4ba0c48a67842aa91fa480a3a62b4a2/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.034301 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab23c48-002d-4556-a8e8-0bb05b8e4c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8def39d8d664b7d808dde309c7cde98, user_id=f4ba0c48a67842aa91fa480a3a62b4a2, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.036979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab23c48-002d-4556-a8e8-0bb05b8e4c7f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.047448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347500f3-1d08-4bd5-914c-978bd5064666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f45b367d650453c98670298fdf24b7c, user_id=1d91cd00d4814a1c95ae72c5422be250, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.050188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347500f3-1d08-4bd5-914c-978bd5064666 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.050841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1351/2724] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:04 2022] PUT /identity/v3/projects/f8def39d8d664b7d808dde309c7cde98/users/f4ba0c48a67842aa91fa480a3a62b4a2/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:04.062229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784ad9-5d7a-4538-a199-4e0d5675bbbd None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.062597 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784ad9-5d7a-4538-a199-4e0d5675bbbd None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.062876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e784ad9-5d7a-4538-a199-4e0d5675bbbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.065706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1374/2725] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:04 2022] PUT /identity/v3/projects/4f45b367d650453c98670298fdf24b7c/users/1d91cd00d4814a1c95ae72c5422be250/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:04.069740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347500f3-1d08-4bd5-914c-978bd5064666 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.096371 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-1e784ad9-5d7a-4538-a199-4e0d5675bbbd None None] MFA Rules not processed for user `f4ba0c48a67842aa91fa480a3a62b4a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:04.097801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1e784ad9-5d7a-4538-a199-4e0d5675bbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:04.140227 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347500f3-1d08-4bd5-914c-978bd5064666 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.148287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66577412-bf78-47dd-990a-39fcd7fe0e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.148287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66577412-bf78-47dd-990a-39fcd7fe0e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.148287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66577412-bf78-47dd-990a-39fcd7fe0e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.148287 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66577412-bf78-47dd-990a-39fcd7fe0e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.148729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66577412-bf78-47dd-990a-39fcd7fe0e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.149634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66577412-bf78-47dd-990a-39fcd7fe0e7d admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.160600 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1375/2726] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:04.165106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66577412-bf78-47dd-990a-39fcd7fe0e7d admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.175589 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66577412-bf78-47dd-990a-39fcd7fe0e7d admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.177657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1352/2727] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:04.180520 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc6a79-0b6d-41d4-819c-fe8c82593ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.181429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6a79-0b6d-41d4-819c-fe8c82593ce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.181692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6a79-0b6d-41d4-819c-fe8c82593ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.181965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc6a79-0b6d-41d4-819c-fe8c82593ce4 admin admin] PATH_INFO: `/v3/projects/4f45b367d650453c98670298fdf24b7c/users/1d91cd00d4814a1c95ae72c5422be250/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.184197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc6a79-0b6d-41d4-819c-fe8c82593ce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f45b367d650453c98670298fdf24b7c, user_id=1d91cd00d4814a1c95ae72c5422be250, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.186838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fc6a79-0b6d-41d4-819c-fe8c82593ce4 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.190034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e784ad9-5d7a-4538-a199-4e0d5675bbbd None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.191501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1e784ad9-5d7a-4538-a199-4e0d5675bbbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:04.197976 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1376/2728] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:04 2022] PUT /identity/v3/projects/4f45b367d650453c98670298fdf24b7c/users/1d91cd00d4814a1c95ae72c5422be250/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:04.209852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04590-662a-4da2-94a4-95cb27e2b149 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.210239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04590-662a-4da2-94a4-95cb27e2b149 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.210551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c04590-662a-4da2-94a4-95cb27e2b149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.237955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-74c04590-662a-4da2-94a4-95cb27e2b149 None None] MFA Rules not processed for user `1d91cd00d4814a1c95ae72c5422be250`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:04.239225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-74c04590-662a-4da2-94a4-95cb27e2b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:04.249553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e784ad9-5d7a-4538-a199-4e0d5675bbbd None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.260811 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:04.299061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54d316-d697-4ffa-b023-e7d043cd48dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.299863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d316-d697-4ffa-b023-e7d043cd48dd service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.300155 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d316-d697-4ffa-b023-e7d043cd48dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.300513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d316-d697-4ffa-b023-e7d043cd48dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.310619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1377/2729] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:04.319856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:04.323545 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04590-662a-4da2-94a4-95cb27e2b149 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.325453 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-74c04590-662a-4da2-94a4-95cb27e2b149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:04.338135 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c04590-662a-4da2-94a4-95cb27e2b149 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.341993 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5072dcf-1cc2-470f-baf1-284669b9db23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.343234 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5072dcf-1cc2-470f-baf1-284669b9db23 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.343781 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5072dcf-1cc2-470f-baf1-284669b9db23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.344293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5072dcf-1cc2-470f-baf1-284669b9db23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.357541 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5072dcf-1cc2-470f-baf1-284669b9db23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.359636 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5072dcf-1cc2-470f-baf1-284669b9db23 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.369707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1378/2730] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:04.373313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54d316-d697-4ffa-b023-e7d043cd48dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.374915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54d316-d697-4ffa-b023-e7d043cd48dd service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.385227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1353/2731] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:04 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:51:04.457012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5072dcf-1cc2-470f-baf1-284669b9db23 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.458329 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54d316-d697-4ffa-b023-e7d043cd48dd service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.466784 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5072dcf-1cc2-470f-baf1-284669b9db23 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.471515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d34a7-2c89-4e20-85bc-ae0f907d353b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.472218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d34a7-2c89-4e20-85bc-ae0f907d353b service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.472502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d34a7-2c89-4e20-85bc-ae0f907d353b service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.472777 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d34a7-2c89-4e20-85bc-ae0f907d353b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.527257 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54d316-d697-4ffa-b023-e7d043cd48dd service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.532865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.533875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.534192 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.534520 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] PATH_INFO: `/v3/users/f6ebb048d6064c7f8867ee10e5967a94` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.535931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ebb048d6064c7f8867ee10e5967a94)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.537296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d34a7-2c89-4e20-85bc-ae0f907d353b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.537971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.538773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d34a7-2c89-4e20-85bc-ae0f907d353b service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.548675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1379/2732] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:04.595967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ebb048d6064c7f8867ee10e5967a94'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:04.605051 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ebb048d6064c7f8867ee10e5967a94'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:04.605996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ebb048d6064c7f8867ee10e5967a94'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:04.613808 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ebb048d6064c7f8867ee10e5967a94'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:04.628796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ebb048d6064c7f8867ee10e5967a94'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:04.636391 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1354/2733] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:04 2022] DELETE /identity/v3/users/f6ebb048d6064c7f8867ee10e5967a94 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:04.641399 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030770-7e08-4b78-8573-f2775d4a386a None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.641707 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030770-7e08-4b78-8573-f2775d4a386a None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.642012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a030770-7e08-4b78-8573-f2775d4a386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.661580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-4a030770-7e08-4b78-8573-f2775d4a386a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:04.662890 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4a030770-7e08-4b78-8573-f2775d4a386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:04.731072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1380/2734] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:04.743006 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:04.744885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:04.785198 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:04.813347 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8410d-3041-42d9-ad34-d82f470f60a0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:04.817254 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7990-ba1a-4eb6-bac4-5870c78d4c63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:04.817956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7990-ba1a-4eb6-bac4-5870c78d4c63 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:04.818242 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7990-ba1a-4eb6-bac4-5870c78d4c63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:04.818518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed7990-ba1a-4eb6-bac4-5870c78d4c63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:04.829122 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed7990-ba1a-4eb6-bac4-5870c78d4c63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:04.830751 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed7990-ba1a-4eb6-bac4-5870c78d4c63 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:04.843648 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1355/2735] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:05.413729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a030770-7e08-4b78-8573-f2775d4a386a None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:05.415251 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-4a030770-7e08-4b78-8573-f2775d4a386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:05.427619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a030770-7e08-4b78-8573-f2775d4a386a None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:05.433868 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:05.434748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:05.435027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:05.435502 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] PATH_INFO: `/v3/projects/a395bd26656749c6b387d281e4884785` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:05.436914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a395bd26656749c6b387d281e4884785)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:05.438881 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:05.479179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:05.489076 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a395bd26656749c6b387d281e4884785', 'request_id': 'req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.495773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a395bd26656749c6b387d281e4884785', 'request_id': 'req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.505302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a395bd26656749c6b387d281e4884785', 'request_id': 'req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.516247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] The token cache is being invalidate because project a395bd26656749c6b387d281e4884785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:05.516529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.517200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.518802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1381/2736] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:05 2022] DELETE /identity/v3/projects/a395bd26656749c6b387d281e4884785 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:05.522869 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7990-ba1a-4eb6-bac4-5870c78d4c63 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:05.532943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed7990-ba1a-4eb6-bac4-5870c78d4c63 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:05.593321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:05.594261 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:05.594549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:05.594824 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] PATH_INFO: `/v3/users/f4ba0c48a67842aa91fa480a3a62b4a2` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:05.596082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ba0c48a67842aa91fa480a3a62b4a2)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:05.598119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:05.648202 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ba0c48a67842aa91fa480a3a62b4a2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.657037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ba0c48a67842aa91fa480a3a62b4a2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.657564 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ba0c48a67842aa91fa480a3a62b4a2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.664635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ba0c48a67842aa91fa480a3a62b4a2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.677196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2252d980-9398-4c40-a442-197a6bf9ae46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ba0c48a67842aa91fa480a3a62b4a2'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:05.683775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1356/2737] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:05 2022] DELETE /identity/v3/users/f4ba0c48a67842aa91fa480a3a62b4a2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:05.984264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:05.986067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:06.002901 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3241d-0465-4c6b-87d5-0c2f0d967b8f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.082064 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.082945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.083222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.083491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] PATH_INFO: `/v3/projects/f8def39d8d664b7d808dde309c7cde98` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.084737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8def39d8d664b7d808dde309c7cde98)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.086905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.138746 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8def39d8d664b7d808dde309c7cde98', 'request_id': 'req-db167a7f-9a7e-4e8c-89fe-421b75cd1775'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:06.145224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8def39d8d664b7d808dde309c7cde98', 'request_id': 'req-db167a7f-9a7e-4e8c-89fe-421b75cd1775'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:06.154049 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8def39d8d664b7d808dde309c7cde98', 'request_id': 'req-db167a7f-9a7e-4e8c-89fe-421b75cd1775'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:06.165450 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] The token cache is being invalidate because project f8def39d8d664b7d808dde309c7cde98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:06.165658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:06.166292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-db167a7f-9a7e-4e8c-89fe-421b75cd1775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:06.167883 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1382/2738] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:05 2022] DELETE /identity/v3/projects/f8def39d8d664b7d808dde309c7cde98 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:06.172908 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbadc-19d7-4ac1-becb-d869984e2d72 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.173181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbadc-19d7-4ac1-becb-d869984e2d72 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.173455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607dbadc-19d7-4ac1-becb-d869984e2d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.190904 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-607dbadc-19d7-4ac1-becb-d869984e2d72 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:06.192109 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-607dbadc-19d7-4ac1-becb-d869984e2d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:06.241401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:06.254653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1357/2739] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:06.262435 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81a792-8303-4d70-89de-908d846710a8 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.262848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81a792-8303-4d70-89de-908d846710a8 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.263197 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81a792-8303-4d70-89de-908d846710a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.284201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-eb81a792-8303-4d70-89de-908d846710a8 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:06.285447 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-eb81a792-8303-4d70-89de-908d846710a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:06.297218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1383/2740] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:06.298227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dbadc-19d7-4ac1-becb-d869984e2d72 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.308118 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607dbadc-19d7-4ac1-becb-d869984e2d72 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.312987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.314631 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.314942 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.315218 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.316029 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:06.316338 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.317943 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.332047 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1358/2741] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:51:06.338853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81a792-8303-4d70-89de-908d846710a8 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.347086 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81a792-8303-4d70-89de-908d846710a8 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.353908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb42d88-339b-466b-a0ac-88abf0259e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.354680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb42d88-339b-466b-a0ac-88abf0259e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.355024 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb42d88-339b-466b-a0ac-88abf0259e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.355363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb42d88-339b-466b-a0ac-88abf0259e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.356265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb42d88-339b-466b-a0ac-88abf0259e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.358357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb42d88-339b-466b-a0ac-88abf0259e92 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.386156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1384/2742] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:06 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:06.395297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.405865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd725-cf87-44c7-92da-3f0e7dc85e96 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.472630 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562060b8-4443-43d2-a1c8-3ef715a1ea9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.473495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562060b8-4443-43d2-a1c8-3ef715a1ea9f admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.473784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562060b8-4443-43d2-a1c8-3ef715a1ea9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.474060 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562060b8-4443-43d2-a1c8-3ef715a1ea9f admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.475073 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562060b8-4443-43d2-a1c8-3ef715a1ea9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.477711 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562060b8-4443-43d2-a1c8-3ef715a1ea9f admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.498156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1359/2743] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:06 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:06.503268 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb42d88-339b-466b-a0ac-88abf0259e92 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.514289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb42d88-339b-466b-a0ac-88abf0259e92 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.519927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186f637-fb9d-4cd9-9c89-ef4f47ed2321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.520620 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f637-fb9d-4cd9-9c89-ef4f47ed2321 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.520932 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f637-fb9d-4cd9-9c89-ef4f47ed2321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.521224 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5186f637-fb9d-4cd9-9c89-ef4f47ed2321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.521979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186f637-fb9d-4cd9-9c89-ef4f47ed2321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.523692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5186f637-fb9d-4cd9-9c89-ef4f47ed2321 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.534791 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1385/2744] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:06.539355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562060b8-4443-43d2-a1c8-3ef715a1ea9f admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.549651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562060b8-4443-43d2-a1c8-3ef715a1ea9f admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.554279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c562cf9-7297-4fba-9287-a0710337e152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.555003 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562cf9-7297-4fba-9287-a0710337e152 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.555289 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562cf9-7297-4fba-9287-a0710337e152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.555563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c562cf9-7297-4fba-9287-a0710337e152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.556337 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562cf9-7297-4fba-9287-a0710337e152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.557990 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c562cf9-7297-4fba-9287-a0710337e152 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.568033 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1360/2745] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:06.572537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186f637-fb9d-4cd9-9c89-ef4f47ed2321 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.584485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5186f637-fb9d-4cd9-9c89-ef4f47ed2321 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.589996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59410-98e9-49ca-a0ea-de45ba9bc655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.590968 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59410-98e9-49ca-a0ea-de45ba9bc655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.591259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59410-98e9-49ca-a0ea-de45ba9bc655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.591534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf59410-98e9-49ca-a0ea-de45ba9bc655 admin admin] PATH_INFO: `/v3/projects/13838157d40442f98e7990516419e3b7/users/6960b4b8a7aa4b9f9123d44e4c1f5a2f/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.606914 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf59410-98e9-49ca-a0ea-de45ba9bc655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13838157d40442f98e7990516419e3b7, user_id=6960b4b8a7aa4b9f9123d44e4c1f5a2f, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.609631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf59410-98e9-49ca-a0ea-de45ba9bc655 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.611938 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:06.624992 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1386/2746] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:06 2022] PUT /identity/v3/projects/13838157d40442f98e7990516419e3b7/users/6960b4b8a7aa4b9f9123d44e4c1f5a2f/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:06.636594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea609-29b0-4bd5-816e-6615e8974af8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.636823 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea609-29b0-4bd5-816e-6615e8974af8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.637264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ea609-29b0-4bd5-816e-6615e8974af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.666773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-853ea609-29b0-4bd5-816e-6615e8974af8 None None] MFA Rules not processed for user `6960b4b8a7aa4b9f9123d44e4c1f5a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:06.668096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-853ea609-29b0-4bd5-816e-6615e8974af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:06.734951 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1361/2747] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:06.739863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59410-98e9-49ca-a0ea-de45ba9bc655 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.811328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf59410-98e9-49ca-a0ea-de45ba9bc655 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.816929 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577bb06-fdc3-4b9f-8331-10f2a28663ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.817619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577bb06-fdc3-4b9f-8331-10f2a28663ea admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.817906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577bb06-fdc3-4b9f-8331-10f2a28663ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.818186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577bb06-fdc3-4b9f-8331-10f2a28663ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.818897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577bb06-fdc3-4b9f-8331-10f2a28663ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.820880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577bb06-fdc3-4b9f-8331-10f2a28663ea admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.848935 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1387/2748] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:06 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:06.855044 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ea609-29b0-4bd5-816e-6615e8974af8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.866893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ea609-29b0-4bd5-816e-6615e8974af8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.918008 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:06.930213 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e8d30-66fb-4f2f-b329-cb15e988e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.930898 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e8d30-66fb-4f2f-b329-cb15e988e9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.931180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e8d30-66fb-4f2f-b329-cb15e988e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.931458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e8d30-66fb-4f2f-b329-cb15e988e9e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.932178 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e8d30-66fb-4f2f-b329-cb15e988e9e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.934097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e8d30-66fb-4f2f-b329-cb15e988e9e8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.955280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1362/2749] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:06 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:06.959653 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577bb06-fdc3-4b9f-8331-10f2a28663ea admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:06.970282 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577bb06-fdc3-4b9f-8331-10f2a28663ea admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:06.975767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e0146-2478-4135-ac02-87d3da43dbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:06.976452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0146-2478-4135-ac02-87d3da43dbab admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:06.976737 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0146-2478-4135-ac02-87d3da43dbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:06.977007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e0146-2478-4135-ac02-87d3da43dbab admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:06.977775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e0146-2478-4135-ac02-87d3da43dbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:06.979448 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e0146-2478-4135-ac02-87d3da43dbab admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:06.990554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1388/2750] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:06.994880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e8d30-66fb-4f2f-b329-cb15e988e9e8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:07.005481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e8d30-66fb-4f2f-b329-cb15e988e9e8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:07.010517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844318db-0c61-4904-846c-a3fd689078f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:07.011406 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844318db-0c61-4904-846c-a3fd689078f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.011729 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844318db-0c61-4904-846c-a3fd689078f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.012010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844318db-0c61-4904-846c-a3fd689078f5 admin admin] PATH_INFO: `/v3/projects/1866929233db4597a5431717c1ee7814/users/ef792589f6ac488eae45f9c509fa6f8e/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.027270 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844318db-0c61-4904-846c-a3fd689078f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1866929233db4597a5431717c1ee7814, user_id=ef792589f6ac488eae45f9c509fa6f8e, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:07.029980 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844318db-0c61-4904-846c-a3fd689078f5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:07.044430 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1363/2751] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:06 2022] PUT /identity/v3/projects/1866929233db4597a5431717c1ee7814/users/ef792589f6ac488eae45f9c509fa6f8e/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:07.048706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e0146-2478-4135-ac02-87d3da43dbab admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:07.059208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e0146-2478-4135-ac02-87d3da43dbab admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:07.127802 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0922c19-bf85-404b-85d9-49c054047c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:07.128492 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0922c19-bf85-404b-85d9-49c054047c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.128773 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0922c19-bf85-404b-85d9-49c054047c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.129044 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0922c19-bf85-404b-85d9-49c054047c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.129761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0922c19-bf85-404b-85d9-49c054047c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:07.131387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0922c19-bf85-404b-85d9-49c054047c4f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:07.141625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1389/2752] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:07.145895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844318db-0c61-4904-846c-a3fd689078f5 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:07.156558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844318db-0c61-4904-846c-a3fd689078f5 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:07.161865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:07.162750 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.163035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.163313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] PATH_INFO: `/v3/projects/1866929233db4597a5431717c1ee7814/users/ef792589f6ac488eae45f9c509fa6f8e/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.165559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1866929233db4597a5431717c1ee7814, user_id=ef792589f6ac488eae45f9c509fa6f8e, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:07.168460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:07.179163 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1364/2753] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:07 2022] PUT /identity/v3/projects/1866929233db4597a5431717c1ee7814/users/ef792589f6ac488eae45f9c509fa6f8e/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:07.190595 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1670d0-5f8a-4c32-9241-b58e3d7eb830 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.190875 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1670d0-5f8a-4c32-9241-b58e3d7eb830 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.191153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1670d0-5f8a-4c32-9241-b58e3d7eb830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.221020 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8c1670d0-5f8a-4c32-9241-b58e3d7eb830 None None] MFA Rules not processed for user `ef792589f6ac488eae45f9c509fa6f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:07.222262 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8c1670d0-5f8a-4c32-9241-b58e3d7eb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:07.275818 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:07.297326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1390/2754] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:07.311962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:07.314762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:07.383875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9fb33b-1be5-48d1-a874-dd34199fcd54 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:07.387532 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa2bc-e826-4cd8-b791-b9784d79a5e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:07.388240 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa2bc-e826-4cd8-b791-b9784d79a5e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.388641 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa2bc-e826-4cd8-b791-b9784d79a5e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.388776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa2bc-e826-4cd8-b791-b9784d79a5e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.399832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa2bc-e826-4cd8-b791-b9784d79a5e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:07.401275 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa2bc-e826-4cd8-b791-b9784d79a5e3 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:07.411668 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1365/2755] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:07.426876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1670d0-5f8a-4c32-9241-b58e3d7eb830 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:07.428508 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8c1670d0-5f8a-4c32-9241-b58e3d7eb830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:07.508627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1670d0-5f8a-4c32-9241-b58e3d7eb830 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:07.519517 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:07.520428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.520705 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.520979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] PATH_INFO: `/v3/users/1f8ed7ba71da45e5af9053a00df26618` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.522218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8ed7ba71da45e5af9053a00df26618)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:07.524244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:07.591646 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8ed7ba71da45e5af9053a00df26618'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.592383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8ed7ba71da45e5af9053a00df26618'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.601874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8ed7ba71da45e5af9053a00df26618'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.618124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8ed7ba71da45e5af9053a00df26618'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.619132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8ed7ba71da45e5af9053a00df26618'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.656716 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1391/2756] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:07 2022] DELETE /identity/v3/users/1f8ed7ba71da45e5af9053a00df26618 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:07.663480 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d047-8d00-49e0-9c20-eac94a52c28a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.664116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d047-8d00-49e0-9c20-eac94a52c28a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.664116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4d047-8d00-49e0-9c20-eac94a52c28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.688133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-77a4d047-8d00-49e0-9c20-eac94a52c28a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:07.689128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-77a4d047-8d00-49e0-9c20-eac94a52c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:07.770541 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1366/2757] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:07.780769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:07.782318 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:07.828119 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4d047-8d00-49e0-9c20-eac94a52c28a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:07.830222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-77a4d047-8d00-49e0-9c20-eac94a52c28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:07.846262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4d047-8d00-49e0-9c20-eac94a52c28a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:07.847879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc64fa7-9a4a-4801-b9d9-e2a62ec1a71e admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:07.852087 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:07.852308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610c4c0-e728-4c1f-ab22-ca63ff8bbddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:07.852999 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c4c0-e728-4c1f-ab22-ca63ff8bbddc service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.853286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c4c0-e728-4c1f-ab22-ca63ff8bbddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.853433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.853559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610c4c0-e728-4c1f-ab22-ca63ff8bbddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.853888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.854260 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] PATH_INFO: `/v3/users/6960b4b8a7aa4b9f9123d44e4c1f5a2f` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.855581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6960b4b8a7aa4b9f9123d44e4c1f5a2f)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:07.857863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:07.866311 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c4c0-e728-4c1f-ab22-ca63ff8bbddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:07.867953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610c4c0-e728-4c1f-ab22-ca63ff8bbddc service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:07.880593 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1392/2758] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:07.908322 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:07.915607 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6960b4b8a7aa4b9f9123d44e4c1f5a2f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.925034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6960b4b8a7aa4b9f9123d44e4c1f5a2f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.925713 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6960b4b8a7aa4b9f9123d44e4c1f5a2f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.934455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6960b4b8a7aa4b9f9123d44e4c1f5a2f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.949792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6960b4b8a7aa4b9f9123d44e4c1f5a2f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:07.957730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1367/2759] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:07 2022] DELETE /identity/v3/users/6960b4b8a7aa4b9f9123d44e4c1f5a2f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:07.962712 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c67e-be03-47ba-a37d-3acb1b3cf3f7 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:07.963105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c67e-be03-47ba-a37d-3acb1b3cf3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:07.963484 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1c67e-be03-47ba-a37d-3acb1b3cf3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:07.982482 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d5d1c67e-be03-47ba-a37d-3acb1b3cf3f7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:07.983830 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d5d1c67e-be03-47ba-a37d-3acb1b3cf3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:07.989507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:08.070751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1393/2760] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:08.081436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:08.083380 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:08.152076 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468d83f-f8b2-4912-b609-ef8df0f33ac9 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:08.156173 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:08.156920 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:08.157278 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:08.157558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:08.168722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:08.170431 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:08.184094 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1368/2761] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:08.194475 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1c67e-be03-47ba-a37d-3acb1b3cf3f7 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:08.196500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d5d1c67e-be03-47ba-a37d-3acb1b3cf3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:08.216057 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1c67e-be03-47ba-a37d-3acb1b3cf3f7 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:08.221863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:08.223286 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:08.224463 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:08.224980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] PATH_INFO: `/v3/projects/c013c968bc084e118e139faeecb8bd4b` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:08.226697 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c013c968bc084e118e139faeecb8bd4b)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:08.229252 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:08.281843 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c013c968bc084e118e139faeecb8bd4b', 'request_id': 'req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.288632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c013c968bc084e118e139faeecb8bd4b', 'request_id': 'req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.296420 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c013c968bc084e118e139faeecb8bd4b', 'request_id': 'req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.307485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] The token cache is being invalidate because project c013c968bc084e118e139faeecb8bd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:08.307804 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.308493 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.310102 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1394/2762] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:08 2022] DELETE /identity/v3/projects/c013c968bc084e118e139faeecb8bd4b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:08.537075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:08.538889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:08.553499 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b997a8-fc4e-400e-9a78-f53d97813ed0 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:08.619397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:08.620303 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:08.620588 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:08.620865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] PATH_INFO: `/v3/projects/13838157d40442f98e7990516419e3b7` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:08.622126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] RBAC: Authorizing `identity:delete_project(project_id=13838157d40442f98e7990516419e3b7)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:08.624096 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:08.674133 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13838157d40442f98e7990516419e3b7', 'request_id': 'req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.682798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13838157d40442f98e7990516419e3b7', 'request_id': 'req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.687553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:08.688863 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13838157d40442f98e7990516419e3b7', 'request_id': 'req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.701626 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] The token cache is being invalidate because project 13838157d40442f98e7990516419e3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:08.701909 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.702534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.704130 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1369/2763] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:08 2022] DELETE /identity/v3/projects/13838157d40442f98e7990516419e3b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:08.708237 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:08.709759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:08.730788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd7ff6e-1eb5-4f43-ae32-ce1e2637dd23 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:08.799429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:08.800257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:08.800538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:08.800796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] PATH_INFO: `/v3/users/ef792589f6ac488eae45f9c509fa6f8e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:08.802069 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef792589f6ac488eae45f9c509fa6f8e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:08.804113 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:08.843223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:08.852917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef792589f6ac488eae45f9c509fa6f8e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.853569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef792589f6ac488eae45f9c509fa6f8e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.860743 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef792589f6ac488eae45f9c509fa6f8e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.867975 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef792589f6ac488eae45f9c509fa6f8e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.868619 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ac269f59-d846-46e2-afac-4b8cde131f0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef792589f6ac488eae45f9c509fa6f8e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:08.886569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1395/2764] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:08 2022] DELETE /identity/v3/users/ef792589f6ac488eae45f9c509fa6f8e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:09.171107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.172921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.192979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea86d4-77ce-46a2-8b8f-f8b12aec0afa admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.253221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.254062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.254345 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.254619 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] PATH_INFO: `/v3/projects/1866929233db4597a5431717c1ee7814` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.255841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1866929233db4597a5431717c1ee7814)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.257794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.307081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1866929233db4597a5431717c1ee7814', 'request_id': 'req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.315081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1866929233db4597a5431717c1ee7814', 'request_id': 'req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.321336 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1866929233db4597a5431717c1ee7814', 'request_id': 'req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.338455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] The token cache is being invalidate because project 1866929233db4597a5431717c1ee7814 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:09.338871 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.339543 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.341531 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1370/2765] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:09 2022] DELETE /identity/v3/projects/1866929233db4597a5431717c1ee7814 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:09.346916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13b6f-e986-4037-800f-ffa28f1fbb4b None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.347315 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13b6f-e986-4037-800f-ffa28f1fbb4b None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.347632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a13b6f-e986-4037-800f-ffa28f1fbb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.368008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b3a13b6f-e986-4037-800f-ffa28f1fbb4b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:09.369285 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b3a13b6f-e986-4037-800f-ffa28f1fbb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.426825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.428594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.434995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1396/2766] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:09.442070 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06c01f-f3e6-4b35-8d6e-ae12911a3c6d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.442852 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cecc12-f096-4011-b31e-55d7662a683e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.443260 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cecc12-f096-4011-b31e-55d7662a683e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.443640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cecc12-f096-4011-b31e-55d7662a683e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.447138 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.448151 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.448444 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.448727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] PATH_INFO: `/v3/users/7d55ac56dcf84e82b61ab80bf32cffa5` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.450526 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d55ac56dcf84e82b61ab80bf32cffa5)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.452505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.462880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-a0cecc12-f096-4011-b31e-55d7662a683e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:09.464123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a0cecc12-f096-4011-b31e-55d7662a683e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.473351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1397/2767] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:09.477609 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cecc12-f096-4011-b31e-55d7662a683e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.488548 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cecc12-f096-4011-b31e-55d7662a683e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.493529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.494226 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.494506 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.494978 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.496190 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:09.496651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.498764 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.501889 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d55ac56dcf84e82b61ab80bf32cffa5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.511208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d55ac56dcf84e82b61ab80bf32cffa5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.511959 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d55ac56dcf84e82b61ab80bf32cffa5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.512105 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1398/2768] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:51:09.516382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.518098 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.519299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d55ac56dcf84e82b61ab80bf32cffa5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.530161 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:09.530382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c892cf7-48f5-47ce-ae20-10a7dacf0c6b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.532494 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-7c069ac7-a0c3-43c7-8510-126e0f44131e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d55ac56dcf84e82b61ab80bf32cffa5'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:09.535910 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc42139-7e7e-47aa-8400-d54dd9472d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.536560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42139-7e7e-47aa-8400-d54dd9472d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.536842 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42139-7e7e-47aa-8400-d54dd9472d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.537148 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc42139-7e7e-47aa-8400-d54dd9472d8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.537844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc42139-7e7e-47aa-8400-d54dd9472d8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.540266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc42139-7e7e-47aa-8400-d54dd9472d8f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.540408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1371/2769] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:09 2022] DELETE /identity/v3/users/7d55ac56dcf84e82b61ab80bf32cffa5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:09.544809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac89b-edf7-48b8-a315-f8352ad5e8cf None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.545091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac89b-edf7-48b8-a315-f8352ad5e8cf None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.545365 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ac89b-edf7-48b8-a315-f8352ad5e8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.563426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-9f0ac89b-edf7-48b8-a315-f8352ad5e8cf None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:09.564860 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9f0ac89b-edf7-48b8-a315-f8352ad5e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.571575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1399/2770] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:09 2022] POST /identity/v3/projects => generated 361 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:09.572792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc42139-7e7e-47aa-8400-d54dd9472d8f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.627102 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1372/2771] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:09.634232 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc42139-7e7e-47aa-8400-d54dd9472d8f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.638170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac89b-edf7-48b8-a315-f8352ad5e8cf None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.638931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ef6e2-6b33-43cb-96bf-fa209290fef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.639796 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef6e2-6b33-43cb-96bf-fa209290fef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.639921 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9f0ac89b-edf7-48b8-a315-f8352ad5e8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.640221 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef6e2-6b33-43cb-96bf-fa209290fef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.640892 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7ef6e2-6b33-43cb-96bf-fa209290fef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.641407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ef6e2-6b33-43cb-96bf-fa209290fef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.643444 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7ef6e2-6b33-43cb-96bf-fa209290fef9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.666971 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1400/2772] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:09 2022] POST /identity/v3/users => generated 281 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:09.671196 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ef6e2-6b33-43cb-96bf-fa209290fef9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.676163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:09.682606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7ef6e2-6b33-43cb-96bf-fa209290fef9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.689051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451b2e7-1f07-4b80-bc59-f27545039e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.689713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451b2e7-1f07-4b80-bc59-f27545039e97 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.690018 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451b2e7-1f07-4b80-bc59-f27545039e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.690291 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451b2e7-1f07-4b80-bc59-f27545039e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.691050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451b2e7-1f07-4b80-bc59-f27545039e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.692686 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451b2e7-1f07-4b80-bc59-f27545039e97 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.703050 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1401/2773] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:09.705737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ac89b-edf7-48b8-a315-f8352ad5e8cf None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.707238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451b2e7-1f07-4b80-bc59-f27545039e97 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.716761 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451b2e7-1f07-4b80-bc59-f27545039e97 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.721799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa0f11-0849-4c1d-a2a2-5421a16d7316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.722436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa0f11-0849-4c1d-a2a2-5421a16d7316 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.722730 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa0f11-0849-4c1d-a2a2-5421a16d7316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.723003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfa0f11-0849-4c1d-a2a2-5421a16d7316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.723792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa0f11-0849-4c1d-a2a2-5421a16d7316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.725395 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfa0f11-0849-4c1d-a2a2-5421a16d7316 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.736125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1402/2774] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:09.740445 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa0f11-0849-4c1d-a2a2-5421a16d7316 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.750130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfa0f11-0849-4c1d-a2a2-5421a16d7316 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:09.754844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.755767 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.756048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.756321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] PATH_INFO: `/v3/projects/da2e6708ab474dd9a87a0d789057032f/users/5c0981d24f624c7d9a39481b749c8c7e/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.757598 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f82c1-837b-4b61-81b0-90f6a9f038df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:09.758255 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f82c1-837b-4b61-81b0-90f6a9f038df service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.758543 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f82c1-837b-4b61-81b0-90f6a9f038df service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.758819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f82c1-837b-4b61-81b0-90f6a9f038df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.768408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f82c1-837b-4b61-81b0-90f6a9f038df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.769859 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f82c1-837b-4b61-81b0-90f6a9f038df service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.772022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da2e6708ab474dd9a87a0d789057032f, user_id=5c0981d24f624c7d9a39481b749c8c7e, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:09.774759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:09.780236 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1373/2775] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:51:09.788512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1403/2776] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:09 2022] PUT /identity/v3/projects/da2e6708ab474dd9a87a0d789057032f/users/5c0981d24f624c7d9a39481b749c8c7e/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:09.798945 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7df7eb-aeed-43cf-bd12-ee5f8d73bec8 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:09.799237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7df7eb-aeed-43cf-bd12-ee5f8d73bec8 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:09.799515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7df7eb-aeed-43cf-bd12-ee5f8d73bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:09.826944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-bc7df7eb-aeed-43cf-bd12-ee5f8d73bec8 None None] MFA Rules not processed for user `5c0981d24f624c7d9a39481b749c8c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:09.828573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-bc7df7eb-aeed-43cf-bd12-ee5f8d73bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.874455 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:09.900356 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1374/2777] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:09.939682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:09.941704 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:09.998924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233f238-1923-419f-82e9-ead8eb5e3d59 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:10.002668 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:10.003319 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.003631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.003936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.012780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:10.014218 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:10.023504 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1404/2778] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:10.039525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7df7eb-aeed-43cf-bd12-ee5f8d73bec8 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:10.068187 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:10.070043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:10.114686 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7df7eb-aeed-43cf-bd12-ee5f8d73bec8 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:10.119569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:10.120586 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.120913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.121186 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] PATH_INFO: `/v3/users/5c0981d24f624c7d9a39481b749c8c7e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.122566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0981d24f624c7d9a39481b749c8c7e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:10.125156 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:10.148678 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f1b4-84e0-4751-ba54-9ee81602a86b service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:10.154022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:10.154972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.155254 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.155554 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] PATH_INFO: `/v3/projects/64dfc797ce7042249b2dc3e4b9579197` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.156877 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64dfc797ce7042249b2dc3e4b9579197)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:10.158762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:10.179348 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0981d24f624c7d9a39481b749c8c7e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.187777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0981d24f624c7d9a39481b749c8c7e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.188718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0981d24f624c7d9a39481b749c8c7e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.196397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0981d24f624c7d9a39481b749c8c7e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.208562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-3b34af1c-d4df-4ae8-9e86-75da7ba5243d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0981d24f624c7d9a39481b749c8c7e'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.208927 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64dfc797ce7042249b2dc3e4b9579197', 'request_id': 'req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.216732 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1375/2779] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:10 2022] DELETE /identity/v3/users/5c0981d24f624c7d9a39481b749c8c7e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:10.219829 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bb62d-b4d6-464e-9240-179de816d35b None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.220694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64dfc797ce7042249b2dc3e4b9579197', 'request_id': 'req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.220847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bb62d-b4d6-464e-9240-179de816d35b None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.220847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987bb62d-b4d6-464e-9240-179de816d35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.229632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64dfc797ce7042249b2dc3e4b9579197', 'request_id': 'req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.231029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:10.238584 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-987bb62d-b4d6-464e-9240-179de816d35b None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:10.240107 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-987bb62d-b4d6-464e-9240-179de816d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:10.247810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] The token cache is being invalidate because project 64dfc797ce7042249b2dc3e4b9579197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:10.248204 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.248916 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.250556 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1405/2780] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:10 2022] DELETE /identity/v3/projects/64dfc797ce7042249b2dc3e4b9579197 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:10.254710 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:10.256118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:10.302971 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1376/2781] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:10.312985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bb62d-b4d6-464e-9240-179de816d35b None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:10.314446 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-987bb62d-b4d6-464e-9240-179de816d35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:10.319650 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:10.320059 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a4e25-da9d-4503-b5f4-ee9c17ee4893 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:10.326088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:10.327123 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.327458 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.327835 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] PATH_INFO: `/v3/users/1d91cd00d4814a1c95ae72c5422be250` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.329100 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d91cd00d4814a1c95ae72c5422be250)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:10.331101 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:10.376770 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987bb62d-b4d6-464e-9240-179de816d35b None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:10.379338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d91cd00d4814a1c95ae72c5422be250'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.380367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d91cd00d4814a1c95ae72c5422be250'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.380730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:10.381433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.381740 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.382017 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.388965 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d91cd00d4814a1c95ae72c5422be250'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.392956 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:10.394467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:10.396143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d91cd00d4814a1c95ae72c5422be250'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.396841 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d91cd00d4814a1c95ae72c5422be250'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.404418 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1377/2782] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:51:10.414215 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1406/2783] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:10 2022] DELETE /identity/v3/users/1d91cd00d4814a1c95ae72c5422be250 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:10.776960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:10.778515 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:10.786034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:10.789553 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:10.793290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910672e-5696-452d-af70-47a47942aed3 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:10.868660 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb24ad5-dcf7-44e0-99d2-3660564343b2 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:10.873393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:10.874304 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.874579 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.874863 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] PATH_INFO: `/v3/projects/4f45b367d650453c98670298fdf24b7c` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.876126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:10.876299 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f45b367d650453c98670298fdf24b7c)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:10.877072 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.877354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.877637 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] PATH_INFO: `/v3/projects/da2e6708ab474dd9a87a0d789057032f` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.878110 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:10.878885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=da2e6708ab474dd9a87a0d789057032f)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:10.880895 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:10.891001 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:10.929618 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da2e6708ab474dd9a87a0d789057032f', 'request_id': 'req-2b548e40-5d37-4077-88a9-c4c14bce1acc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.932051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f45b367d650453c98670298fdf24b7c', 'request_id': 'req-a1f70c7b-ab34-4e85-bbea-2b4b41744624'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.937549 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da2e6708ab474dd9a87a0d789057032f', 'request_id': 'req-2b548e40-5d37-4077-88a9-c4c14bce1acc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.939181 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f45b367d650453c98670298fdf24b7c', 'request_id': 'req-a1f70c7b-ab34-4e85-bbea-2b4b41744624'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.944634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da2e6708ab474dd9a87a0d789057032f', 'request_id': 'req-2b548e40-5d37-4077-88a9-c4c14bce1acc'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.947068 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f45b367d650453c98670298fdf24b7c', 'request_id': 'req-a1f70c7b-ab34-4e85-bbea-2b4b41744624'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.956819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] The token cache is being invalidate because project da2e6708ab474dd9a87a0d789057032f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:10.957108 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.957777 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-2b548e40-5d37-4077-88a9-c4c14bce1acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.959474 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1378/2784] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:10 2022] DELETE /identity/v3/projects/da2e6708ab474dd9a87a0d789057032f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:10.960138 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] The token cache is being invalidate because project 4f45b367d650453c98670298fdf24b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:10.960442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.961088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1f70c7b-ab34-4e85-bbea-2b4b41744624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:10.962706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1407/2785] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:10 2022] DELETE /identity/v3/projects/4f45b367d650453c98670298fdf24b7c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:10.964654 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc37ce-5c08-4f74-a577-70055de94a1d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.964948 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc37ce-5c08-4f74-a577-70055de94a1d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.965228 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afc37ce-5c08-4f74-a577-70055de94a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.967419 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470cc70-d114-4753-8768-c6ea96a5dc72 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:10.967745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470cc70-d114-4753-8768-c6ea96a5dc72 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:10.968034 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470cc70-d114-4753-8768-c6ea96a5dc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:10.984570 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-5afc37ce-5c08-4f74-a577-70055de94a1d None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:10.985802 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-5afc37ce-5c08-4f74-a577-70055de94a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:10.986237 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-6470cc70-d114-4753-8768-c6ea96a5dc72 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:10.987451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-6470cc70-d114-4753-8768-c6ea96a5dc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:11.021250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:11.049250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1408/2786] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:11.064233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1379/2787] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:11.064451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64190a-9115-4ac8-b694-4abb45b81344 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.064451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64190a-9115-4ac8-b694-4abb45b81344 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.064451 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64190a-9115-4ac8-b694-4abb45b81344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.065704 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45653c08-0569-41df-a5cb-9ccda0d4669a None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.065996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45653c08-0569-41df-a5cb-9ccda0d4669a None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.066271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45653c08-0569-41df-a5cb-9ccda0d4669a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.076667 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-9f64190a-9115-4ac8-b694-4abb45b81344 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:11.077864 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-9f64190a-9115-4ac8-b694-4abb45b81344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:11.084944 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-45653c08-0569-41df-a5cb-9ccda0d4669a None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:11.085961 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1409/2788] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:11.086170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-45653c08-0569-41df-a5cb-9ccda0d4669a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:11.090255 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64190a-9115-4ac8-b694-4abb45b81344 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.094397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1380/2789] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:11.098846 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45653c08-0569-41df-a5cb-9ccda0d4669a None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.102147 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64190a-9115-4ac8-b694-4abb45b81344 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.107067 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.107838 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.107960 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45653c08-0569-41df-a5cb-9ccda0d4669a None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.108143 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.108385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.109259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:11.109572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.111230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.112779 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.113390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.113994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.113994 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.114659 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:11.114962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.116569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.123405 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1410/2790] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:51:11.127770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.131399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1381/2791] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 13:51:11.135555 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.137578 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a186f11-9c10-4bb9-ba85-17d1b9f3f381 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.142296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ee41-918c-4b90-be58-1b7ce78cb7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.142931 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ee41-918c-4b90-be58-1b7ce78cb7f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.143206 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ee41-918c-4b90-be58-1b7ce78cb7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.143480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ee41-918c-4b90-be58-1b7ce78cb7f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.144205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ee41-918c-4b90-be58-1b7ce78cb7f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.145660 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9f15c-106e-4ed5-87a2-d3e757494c8b admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.146166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ee41-918c-4b90-be58-1b7ce78cb7f3 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.150355 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f54ba-99d1-4f9a-a098-b9605266113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.151089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f54ba-99d1-4f9a-a098-b9605266113d admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.151293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f54ba-99d1-4f9a-a098-b9605266113d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.151569 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f54ba-99d1-4f9a-a098-b9605266113d admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.152290 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f54ba-99d1-4f9a-a098-b9605266113d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.154175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f54ba-99d1-4f9a-a098-b9605266113d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.173202 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1411/2792] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:11 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:11.177434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ee41-918c-4b90-be58-1b7ce78cb7f3 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.183651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1382/2793] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:11 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:11.184556 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f54ba-99d1-4f9a-a098-b9605266113d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.237543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:11.241288 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ee41-918c-4b90-be58-1b7ce78cb7f3 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.247745 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cc89b-5195-48f8-9b9b-50671e5b0fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.248407 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cc89b-5195-48f8-9b9b-50671e5b0fc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.248919 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cc89b-5195-48f8-9b9b-50671e5b0fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.249505 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cc89b-5195-48f8-9b9b-50671e5b0fc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.250256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cc89b-5195-48f8-9b9b-50671e5b0fc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.251298 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f54ba-99d1-4f9a-a098-b9605266113d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.253915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cc89b-5195-48f8-9b9b-50671e5b0fc0 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.256670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56302371-701e-46ad-b9fe-00d177fd156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.257394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56302371-701e-46ad-b9fe-00d177fd156e admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.257678 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56302371-701e-46ad-b9fe-00d177fd156e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.257958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56302371-701e-46ad-b9fe-00d177fd156e admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.258798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56302371-701e-46ad-b9fe-00d177fd156e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.260826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56302371-701e-46ad-b9fe-00d177fd156e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.275465 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1412/2794] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:11 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:11.279534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cc89b-5195-48f8-9b9b-50671e5b0fc0 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.283364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1383/2795] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:11 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:11.287484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56302371-701e-46ad-b9fe-00d177fd156e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.290943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cc89b-5195-48f8-9b9b-50671e5b0fc0 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.294944 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f308f0-e274-4760-8642-45af2ebdecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.295675 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f308f0-e274-4760-8642-45af2ebdecf6 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.295956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f308f0-e274-4760-8642-45af2ebdecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.296230 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f308f0-e274-4760-8642-45af2ebdecf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.297144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f308f0-e274-4760-8642-45af2ebdecf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.297862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56302371-701e-46ad-b9fe-00d177fd156e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.298855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f308f0-e274-4760-8642-45af2ebdecf6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.303099 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459aff-47e5-41ac-9965-8ae92c4fd447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.303838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459aff-47e5-41ac-9965-8ae92c4fd447 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.304120 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459aff-47e5-41ac-9965-8ae92c4fd447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.304392 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53459aff-47e5-41ac-9965-8ae92c4fd447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.305696 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53459aff-47e5-41ac-9965-8ae92c4fd447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.307334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53459aff-47e5-41ac-9965-8ae92c4fd447 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.309447 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1413/2796] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:11.313301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f308f0-e274-4760-8642-45af2ebdecf6 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.317773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1384/2797] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:11.321635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459aff-47e5-41ac-9965-8ae92c4fd447 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.323048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f308f0-e274-4760-8642-45af2ebdecf6 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.328045 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59998d-5b81-4372-ae97-25758676a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.328718 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59998d-5b81-4372-ae97-25758676a420 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.329005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59998d-5b81-4372-ae97-25758676a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.329283 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59998d-5b81-4372-ae97-25758676a420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.330003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59998d-5b81-4372-ae97-25758676a420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.331581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff59998d-5b81-4372-ae97-25758676a420 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.332273 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53459aff-47e5-41ac-9965-8ae92c4fd447 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.337723 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba05f44-30bc-439d-80db-57bd72d340c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.338439 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05f44-30bc-439d-80db-57bd72d340c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.338725 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05f44-30bc-439d-80db-57bd72d340c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.339002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba05f44-30bc-439d-80db-57bd72d340c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.339822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05f44-30bc-439d-80db-57bd72d340c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.341481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba05f44-30bc-439d-80db-57bd72d340c1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.346557 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1414/2798] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:11.347805 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59998d-5b81-4372-ae97-25758676a420 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.354182 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1385/2799] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:11.358388 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba05f44-30bc-439d-80db-57bd72d340c1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.359428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59998d-5b81-4372-ae97-25758676a420 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.364488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94af8cf-b970-4755-bc30-d7e7e7f4209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.365460 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af8cf-b970-4755-bc30-d7e7e7f4209e admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.365740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af8cf-b970-4755-bc30-d7e7e7f4209e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.366014 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94af8cf-b970-4755-bc30-d7e7e7f4209e admin admin] PATH_INFO: `/v3/projects/a38bc95a8588448fae7b0019f2a065f7/users/e1c2c9a4ed494be4bb14c6fe08a808ad/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.367892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba05f44-30bc-439d-80db-57bd72d340c1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.372646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8badc98-0a94-4c75-8dd8-4460df1b1c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.373573 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badc98-0a94-4c75-8dd8-4460df1b1c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.373857 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badc98-0a94-4c75-8dd8-4460df1b1c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.374132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8badc98-0a94-4c75-8dd8-4460df1b1c22 admin admin] PATH_INFO: `/v3/projects/9b3818bbd19c4f86b94848418dfedcce/users/44d76d2460d14ffe8aa65d19c6336ba9/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.381272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94af8cf-b970-4755-bc30-d7e7e7f4209e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a38bc95a8588448fae7b0019f2a065f7, user_id=e1c2c9a4ed494be4bb14c6fe08a808ad, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.383988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94af8cf-b970-4755-bc30-d7e7e7f4209e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.389681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8badc98-0a94-4c75-8dd8-4460df1b1c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3818bbd19c4f86b94848418dfedcce, user_id=44d76d2460d14ffe8aa65d19c6336ba9, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.392485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8badc98-0a94-4c75-8dd8-4460df1b1c22 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.398840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1415/2800] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:11 2022] PUT /identity/v3/projects/a38bc95a8588448fae7b0019f2a065f7/users/e1c2c9a4ed494be4bb14c6fe08a808ad/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:11.405865 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1386/2801] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:11 2022] PUT /identity/v3/projects/9b3818bbd19c4f86b94848418dfedcce/users/44d76d2460d14ffe8aa65d19c6336ba9/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:11.409338 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb171e6-aadb-4ab3-8e77-65c4160d85af None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.409627 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb171e6-aadb-4ab3-8e77-65c4160d85af None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.409902 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb171e6-aadb-4ab3-8e77-65c4160d85af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.415877 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730246bf-9940-4428-8652-7dcce6b737a1 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.416175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730246bf-9940-4428-8652-7dcce6b737a1 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.416458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730246bf-9940-4428-8652-7dcce6b737a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.436953 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7cb171e6-aadb-4ab3-8e77-65c4160d85af None None] MFA Rules not processed for user `e1c2c9a4ed494be4bb14c6fe08a808ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:11.438501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7cb171e6-aadb-4ab3-8e77-65c4160d85af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:11.448014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-730246bf-9940-4428-8652-7dcce6b737a1 None None] MFA Rules not processed for user `44d76d2460d14ffe8aa65d19c6336ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:11.449283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-730246bf-9940-4428-8652-7dcce6b737a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:11.487674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:11.521995 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1416/2802] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:11.530410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1387/2803] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:51:11.533048 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb171e6-aadb-4ab3-8e77-65c4160d85af None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.534524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7cb171e6-aadb-4ab3-8e77-65c4160d85af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:11.541775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730246bf-9940-4428-8652-7dcce6b737a1 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:11.543208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-730246bf-9940-4428-8652-7dcce6b737a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:11.593231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb171e6-aadb-4ab3-8e77-65c4160d85af None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.596813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97956-1841-42ab-96ec-a8baefe9a708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.597471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97956-1841-42ab-96ec-a8baefe9a708 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.597751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97956-1841-42ab-96ec-a8baefe9a708 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.598027 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db97956-1841-42ab-96ec-a8baefe9a708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.602335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730246bf-9940-4428-8652-7dcce6b737a1 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:11.606123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c3965-b963-42cf-b46f-f569b3765523 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:11.606680 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db97956-1841-42ab-96ec-a8baefe9a708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.606813 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3965-b963-42cf-b46f-f569b3765523 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:11.607071 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3965-b963-42cf-b46f-f569b3765523 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:11.607330 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c3965-b963-42cf-b46f-f569b3765523 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:11.608163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db97956-1841-42ab-96ec-a8baefe9a708 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.615838 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c3965-b963-42cf-b46f-f569b3765523 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:11.617005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1417/2804] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:11.617353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c3965-b963-42cf-b46f-f569b3765523 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:11.626462 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1388/2805] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:51:14.719998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97956-1841-42ab-96ec-a8baefe9a708 service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:14.756361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:14.786780 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db97956-1841-42ab-96ec-a8baefe9a708 service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:14.791570 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:14.792706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:14.792809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:14.793179 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] PATH_INFO: `/v3/users/44d76d2460d14ffe8aa65d19c6336ba9` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:14.794382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d76d2460d14ffe8aa65d19c6336ba9)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:14.796437 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:14.845207 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d76d2460d14ffe8aa65d19c6336ba9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:14.845860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d76d2460d14ffe8aa65d19c6336ba9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:14.856033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d76d2460d14ffe8aa65d19c6336ba9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:14.864100 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d76d2460d14ffe8aa65d19c6336ba9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:14.864752 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d76d2460d14ffe8aa65d19c6336ba9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:14.882967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1418/2806] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:14 2022] DELETE /identity/v3/users/44d76d2460d14ffe8aa65d19c6336ba9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:14.888414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693c40-9c56-49d1-beb4-45c662bac2e7 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:14.888922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693c40-9c56-49d1-beb4-45c662bac2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:14.889081 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34693c40-9c56-49d1-beb4-45c662bac2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:14.907189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-34693c40-9c56-49d1-beb4-45c662bac2e7 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:14.908488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-34693c40-9c56-49d1-beb4-45c662bac2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:14.970752 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1389/2807] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:14.980734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:14.982294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:15.040321 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b54603-2209-4e36-8c94-c47325535f54 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:15.044920 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aff135-418d-4373-b70d-85ede579b275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:15.045604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff135-418d-4373-b70d-85ede579b275 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.045884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff135-418d-4373-b70d-85ede579b275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.046166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aff135-418d-4373-b70d-85ede579b275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.055691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aff135-418d-4373-b70d-85ede579b275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:15.057175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aff135-418d-4373-b70d-85ede579b275 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:15.066650 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1419/2808] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:51:15.347449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34693c40-9c56-49d1-beb4-45c662bac2e7 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:15.348978 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-34693c40-9c56-49d1-beb4-45c662bac2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:15.361550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34693c40-9c56-49d1-beb4-45c662bac2e7 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:15.366639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:15.367634 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.367843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.368116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] PATH_INFO: `/v3/projects/9b3818bbd19c4f86b94848418dfedcce` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.369701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3818bbd19c4f86b94848418dfedcce)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:15.371339 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:15.420988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3818bbd19c4f86b94848418dfedcce', 'request_id': 'req-24d0d135-7aed-4eeb-8fbf-ac32587b659b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:15.431581 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3818bbd19c4f86b94848418dfedcce', 'request_id': 'req-24d0d135-7aed-4eeb-8fbf-ac32587b659b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:15.436498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3818bbd19c4f86b94848418dfedcce', 'request_id': 'req-24d0d135-7aed-4eeb-8fbf-ac32587b659b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:15.437575 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:15.451674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] The token cache is being invalidate because project 9b3818bbd19c4f86b94848418dfedcce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:15.451973 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:15.452727 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-24d0d135-7aed-4eeb-8fbf-ac32587b659b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:15.454241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1390/2809] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:15 2022] DELETE /identity/v3/projects/9b3818bbd19c4f86b94848418dfedcce => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:15.459900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdedea-eb98-46a2-a742-62685dd2d66e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.460308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdedea-eb98-46a2-a742-62685dd2d66e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.460700 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bdedea-eb98-46a2-a742-62685dd2d66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.482109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-07bdedea-eb98-46a2-a742-62685dd2d66e None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:15.483715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-07bdedea-eb98-46a2-a742-62685dd2d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:15.539124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:15.552911 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1420/2810] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:15.561053 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6da15-188a-482d-9c34-1e44c2ed4616 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.561343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6da15-188a-482d-9c34-1e44c2ed4616 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.561614 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d6da15-188a-482d-9c34-1e44c2ed4616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.581463 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-13d6da15-188a-482d-9c34-1e44c2ed4616 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:15.582675 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-13d6da15-188a-482d-9c34-1e44c2ed4616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:15.590964 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1391/2811] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:15.595759 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdedea-eb98-46a2-a742-62685dd2d66e None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:15.606317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bdedea-eb98-46a2-a742-62685dd2d66e None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:15.612222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:15.612905 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.613186 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.613457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.614203 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:15.614529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:15.616157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:15.628524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1421/2812] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:51:15.633034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6da15-188a-482d-9c34-1e44c2ed4616 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:15.642843 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d6da15-188a-482d-9c34-1e44c2ed4616 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:15.648896 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a3d71-2f40-4929-b2e1-457664c46db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:15.649563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3d71-2f40-4929-b2e1-457664c46db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.649845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3d71-2f40-4929-b2e1-457664c46db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.650115 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3d71-2f40-4929-b2e1-457664c46db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.650798 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a3d71-2f40-4929-b2e1-457664c46db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:15.654264 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a3d71-2f40-4929-b2e1-457664c46db5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:15.682309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1392/2813] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:15 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:15.686859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:15.697425 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a53ea6-55a1-406e-b78f-95ea0fbfa451 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:15.755412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d760c5-5097-429f-814e-6465541c3093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:15.756073 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d760c5-5097-429f-814e-6465541c3093 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.756300 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d760c5-5097-429f-814e-6465541c3093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.756569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d760c5-5097-429f-814e-6465541c3093 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.757267 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d760c5-5097-429f-814e-6465541c3093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:15.759175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d760c5-5097-429f-814e-6465541c3093 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:15.781149 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1422/2814] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:15 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:15.785614 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a3d71-2f40-4929-b2e1-457664c46db5 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:15.796377 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a3d71-2f40-4929-b2e1-457664c46db5 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:15.801435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9d7af-bc3f-4dac-b3a3-543cef24af2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:15.802095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d7af-bc3f-4dac-b3a3-543cef24af2c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.802373 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d7af-bc3f-4dac-b3a3-543cef24af2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.802643 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9d7af-bc3f-4dac-b3a3-543cef24af2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.803404 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9d7af-bc3f-4dac-b3a3-543cef24af2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:15.805054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef9d7af-bc3f-4dac-b3a3-543cef24af2c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:15.815915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1393/2815] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 13:51:15.820373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d760c5-5097-429f-814e-6465541c3093 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:15.831414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d760c5-5097-429f-814e-6465541c3093 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:15.836928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db67292-9f40-4aba-912e-79bd979e163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:15.837616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67292-9f40-4aba-912e-79bd979e163e admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.837900 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67292-9f40-4aba-912e-79bd979e163e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.838172 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db67292-9f40-4aba-912e-79bd979e163e admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.838981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67292-9f40-4aba-912e-79bd979e163e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:15.840604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db67292-9f40-4aba-912e-79bd979e163e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:15.851942 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1423/2816] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:15.856199 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9d7af-bc3f-4dac-b3a3-543cef24af2c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:15.866792 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9d7af-bc3f-4dac-b3a3-543cef24af2c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:15.872025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:15.872922 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.873200 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.873470 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] PATH_INFO: `/v3/projects/27fb400d75fa43ceb4f11d7a5af73d41/users/19bc78c4df3841bb8fa2f5344def326b/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.890970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fb400d75fa43ceb4f11d7a5af73d41, user_id=19bc78c4df3841bb8fa2f5344def326b, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:15.894082 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:15.917179 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1394/2817] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:15 2022] PUT /identity/v3/projects/27fb400d75fa43ceb4f11d7a5af73d41/users/19bc78c4df3841bb8fa2f5344def326b/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:15.930155 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a9897-224e-4e8d-9922-8155034137b2 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:15.930501 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a9897-224e-4e8d-9922-8155034137b2 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:15.930711 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a9897-224e-4e8d-9922-8155034137b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:15.961294 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c45a9897-224e-4e8d-9922-8155034137b2 None None] MFA Rules not processed for user `19bc78c4df3841bb8fa2f5344def326b`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:15.962489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c45a9897-224e-4e8d-9922-8155034137b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:16.049357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1424/2818] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:16.061587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:16.063525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:16.127784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e0b2-221f-4a7a-9e8e-e05225f70ce8 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:16.131763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa428b41-0d26-4610-8e31-bb9248d7ce18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:16.132525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428b41-0d26-4610-8e31-bb9248d7ce18 service glance] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:16.132809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428b41-0d26-4610-8e31-bb9248d7ce18 service glance] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:16.133083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa428b41-0d26-4610-8e31-bb9248d7ce18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:16.142400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa428b41-0d26-4610-8e31-bb9248d7ce18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:16.143875 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa428b41-0d26-4610-8e31-bb9248d7ce18 service glance] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:16.153386 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1395/2819] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:17.046013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a9897-224e-4e8d-9922-8155034137b2 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:17.047529 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c45a9897-224e-4e8d-9922-8155034137b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:17.102314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:17.117485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a9897-224e-4e8d-9922-8155034137b2 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:17.122514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:17.123414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:17.123699 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:17.123986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] PATH_INFO: `/v3/users/e1c2c9a4ed494be4bb14c6fe08a808ad` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:17.125225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c2c9a4ed494be4bb14c6fe08a808ad)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:17.127154 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:17.177551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c2c9a4ed494be4bb14c6fe08a808ad'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.178244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c2c9a4ed494be4bb14c6fe08a808ad'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.186582 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c2c9a4ed494be4bb14c6fe08a808ad'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.194192 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c2c9a4ed494be4bb14c6fe08a808ad'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.194912 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c2c9a4ed494be4bb14c6fe08a808ad'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.212632 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1425/2820] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:17 2022] DELETE /identity/v3/users/e1c2c9a4ed494be4bb14c6fe08a808ad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:17.217350 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255e3f-b873-4ad1-adbe-58917549c086 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:17.217967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255e3f-b873-4ad1-adbe-58917549c086 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:17.217967 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa255e3f-b873-4ad1-adbe-58917549c086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:17.235416 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-fa255e3f-b873-4ad1-adbe-58917549c086 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:17.236671 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fa255e3f-b873-4ad1-adbe-58917549c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:17.300069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1396/2821] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:17.310029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:17.311625 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:17.373165 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303af036-8296-4fdb-95c7-a0b7c0676995 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:17.377047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3b0cff-ee59-4bed-bd82-c9dcd6ee023d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:17.377715 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0cff-ee59-4bed-bd82-c9dcd6ee023d service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:17.377998 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0cff-ee59-4bed-bd82-c9dcd6ee023d service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:17.378272 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0cff-ee59-4bed-bd82-c9dcd6ee023d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:17.388421 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b0cff-ee59-4bed-bd82-c9dcd6ee023d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:17.389854 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3b0cff-ee59-4bed-bd82-c9dcd6ee023d service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:17.400689 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1426/2822] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:17.695736 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255e3f-b873-4ad1-adbe-58917549c086 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:17.697251 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-fa255e3f-b873-4ad1-adbe-58917549c086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:17.716981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa255e3f-b873-4ad1-adbe-58917549c086 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:17.723773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:17.724722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:17.725165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:17.725553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] PATH_INFO: `/v3/projects/a38bc95a8588448fae7b0019f2a065f7` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:17.727513 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a38bc95a8588448fae7b0019f2a065f7)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:17.729633 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:17.766468 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:17.783870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a38bc95a8588448fae7b0019f2a065f7', 'request_id': 'req-e1524b1a-9077-44aa-916c-56add5de2a23'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.792985 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a38bc95a8588448fae7b0019f2a065f7', 'request_id': 'req-e1524b1a-9077-44aa-916c-56add5de2a23'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.799299 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a38bc95a8588448fae7b0019f2a065f7', 'request_id': 'req-e1524b1a-9077-44aa-916c-56add5de2a23'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.811049 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] The token cache is being invalidate because project a38bc95a8588448fae7b0019f2a065f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:17.811399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.812035 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-e1524b1a-9077-44aa-916c-56add5de2a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:17.813742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1397/2823] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:17 2022] DELETE /identity/v3/projects/a38bc95a8588448fae7b0019f2a065f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:17.819193 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f31e0-37c7-44ca-a9fa-cbce2768fd40 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:17.819518 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f31e0-37c7-44ca-a9fa-cbce2768fd40 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:17.819848 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f31e0-37c7-44ca-a9fa-cbce2768fd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:17.838662 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-c03f31e0-37c7-44ca-a9fa-cbce2768fd40 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:17.839972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-c03f31e0-37c7-44ca-a9fa-cbce2768fd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:17.900237 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1427/2824] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:17.908748 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b427da-9dcb-4f70-9b56-0031eb9f5ad4 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:17.909036 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b427da-9dcb-4f70-9b56-0031eb9f5ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:17.909413 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b427da-9dcb-4f70-9b56-0031eb9f5ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:17.929885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-b3b427da-9dcb-4f70-9b56-0031eb9f5ad4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:17.931103 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-b3b427da-9dcb-4f70-9b56-0031eb9f5ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:17.940028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1398/2825] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:17.944503 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f31e0-37c7-44ca-a9fa-cbce2768fd40 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:17.954708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f31e0-37c7-44ca-a9fa-cbce2768fd40 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:17.959551 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:17.960270 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:17.960566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:17.960831 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:17.961760 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80481) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:17.962077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:17.963775 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:17.973163 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:17.976597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1428/2826] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:51:17.981497 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b427da-9dcb-4f70-9b56-0031eb9f5ad4 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:17.991106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b427da-9dcb-4f70-9b56-0031eb9f5ad4 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:17.996518 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226fea-57c3-49e0-b3c8-29a0cea1b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:17.997194 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226fea-57c3-49e0-b3c8-29a0cea1b89a admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:17.997484 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226fea-57c3-49e0-b3c8-29a0cea1b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:17.997756 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12226fea-57c3-49e0-b3c8-29a0cea1b89a admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:17.998461 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12226fea-57c3-49e0-b3c8-29a0cea1b89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.000421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12226fea-57c3-49e0-b3c8-29a0cea1b89a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.028814 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1399/2827] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:17 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:18.033563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.043832 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2aaa1-c2da-4e2d-9509-62ce81b9fa7c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.102972 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0281514-0d73-4a90-a0f0-17363087770f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.104489 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0281514-0d73-4a90-a0f0-17363087770f admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.104776 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0281514-0d73-4a90-a0f0-17363087770f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.105043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0281514-0d73-4a90-a0f0-17363087770f admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.105739 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0281514-0d73-4a90-a0f0-17363087770f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.107694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0281514-0d73-4a90-a0f0-17363087770f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.132943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1429/2828] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:18 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:18.134258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226fea-57c3-49e0-b3c8-29a0cea1b89a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.145390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12226fea-57c3-49e0-b3c8-29a0cea1b89a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.150625 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f5056-7cea-43fb-9112-1d6da0377742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.151241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f5056-7cea-43fb-9112-1d6da0377742 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.151525 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f5056-7cea-43fb-9112-1d6da0377742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.151842 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f5056-7cea-43fb-9112-1d6da0377742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.152612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f5056-7cea-43fb-9112-1d6da0377742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.154203 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f5056-7cea-43fb-9112-1d6da0377742 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.290932 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1400/2829] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:18.295414 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0281514-0d73-4a90-a0f0-17363087770f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.306347 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0281514-0d73-4a90-a0f0-17363087770f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.312615 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87679ec-dcf4-42a5-818b-753275742dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.313296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87679ec-dcf4-42a5-818b-753275742dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.313582 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87679ec-dcf4-42a5-818b-753275742dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.313860 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87679ec-dcf4-42a5-818b-753275742dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.314603 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87679ec-dcf4-42a5-818b-753275742dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.316253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87679ec-dcf4-42a5-818b-753275742dbd admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.330088 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1430/2830] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:18.334328 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f5056-7cea-43fb-9112-1d6da0377742 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.344931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f5056-7cea-43fb-9112-1d6da0377742 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.350433 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b2046-a08c-41be-b3ee-6f58d5a4470c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.351349 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b2046-a08c-41be-b3ee-6f58d5a4470c admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.351661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b2046-a08c-41be-b3ee-6f58d5a4470c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.351935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b2046-a08c-41be-b3ee-6f58d5a4470c admin admin] PATH_INFO: `/v3/projects/9ed1c045fe0e4a3ca864c7d3feeaa3c0/users/a3321ca5096c4086a84bf55f2d46959f/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.367050 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b2046-a08c-41be-b3ee-6f58d5a4470c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed1c045fe0e4a3ca864c7d3feeaa3c0, user_id=a3321ca5096c4086a84bf55f2d46959f, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.369825 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b2046-a08c-41be-b3ee-6f58d5a4470c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.386963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1401/2831] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:18 2022] PUT /identity/v3/projects/9ed1c045fe0e4a3ca864c7d3feeaa3c0/users/a3321ca5096c4086a84bf55f2d46959f/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:18.398327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb2749-8f77-4f54-b875-61ec3c71f178 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.398608 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb2749-8f77-4f54-b875-61ec3c71f178 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.398879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb2749-8f77-4f54-b875-61ec3c71f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.425525 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-dddb2749-8f77-4f54-b875-61ec3c71f178 None None] MFA Rules not processed for user `a3321ca5096c4086a84bf55f2d46959f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:18.426674 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-dddb2749-8f77-4f54-b875-61ec3c71f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:18.499070 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1431/2832] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:18.500361 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b2046-a08c-41be-b3ee-6f58d5a4470c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.566045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b2046-a08c-41be-b3ee-6f58d5a4470c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.571024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18588e6c-6b14-4ec1-a155-e27c648a0103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.571726 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18588e6c-6b14-4ec1-a155-e27c648a0103 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.572009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18588e6c-6b14-4ec1-a155-e27c648a0103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.572280 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18588e6c-6b14-4ec1-a155-e27c648a0103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.572975 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18588e6c-6b14-4ec1-a155-e27c648a0103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.575238 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18588e6c-6b14-4ec1-a155-e27c648a0103 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.603754 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1402/2833] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:18 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:18.607368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb2749-8f77-4f54-b875-61ec3c71f178 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.618908 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb2749-8f77-4f54-b875-61ec3c71f178 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.681606 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d74b-a7f0-4790-bf27-bf063eeba593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.682032 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d74b-a7f0-4790-bf27-bf063eeba593 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.682310 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d74b-a7f0-4790-bf27-bf063eeba593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.682575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082d74b-a7f0-4790-bf27-bf063eeba593 admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.683364 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082d74b-a7f0-4790-bf27-bf063eeba593 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.685323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082d74b-a7f0-4790-bf27-bf063eeba593 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.701167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:18.708936 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1432/2834] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:18 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:18.713249 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18588e6c-6b14-4ec1-a155-e27c648a0103 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.723979 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18588e6c-6b14-4ec1-a155-e27c648a0103 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.728882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6283-519d-478c-85b2-78ed649430a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.729550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6283-519d-478c-85b2-78ed649430a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.729833 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6283-519d-478c-85b2-78ed649430a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.730266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b6283-519d-478c-85b2-78ed649430a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.731015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b6283-519d-478c-85b2-78ed649430a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.732681 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b6283-519d-478c-85b2-78ed649430a1 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.747065 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1403/2835] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:18.748334 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d74b-a7f0-4790-bf27-bf063eeba593 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.759656 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082d74b-a7f0-4790-bf27-bf063eeba593 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.767748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c922e67-08ed-4f10-ae9e-24c33b257eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.768788 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922e67-08ed-4f10-ae9e-24c33b257eca admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.769228 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922e67-08ed-4f10-ae9e-24c33b257eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.769666 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c922e67-08ed-4f10-ae9e-24c33b257eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.770856 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c922e67-08ed-4f10-ae9e-24c33b257eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.773397 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c922e67-08ed-4f10-ae9e-24c33b257eca admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.789672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1433/2836] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:18.794467 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6283-519d-478c-85b2-78ed649430a1 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:18.805227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b6283-519d-478c-85b2-78ed649430a1 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:18.811269 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05068fb0-de5b-4936-9d42-cb60474a953a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:18.812288 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05068fb0-de5b-4936-9d42-cb60474a953a admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.812563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05068fb0-de5b-4936-9d42-cb60474a953a admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.812834 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05068fb0-de5b-4936-9d42-cb60474a953a admin admin] PATH_INFO: `/v3/projects/4c0d1513308f4289b4dd382e3358d523/users/afd95c6ec82547a5b567392089e41279/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.828781 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05068fb0-de5b-4936-9d42-cb60474a953a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c0d1513308f4289b4dd382e3358d523, user_id=afd95c6ec82547a5b567392089e41279, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:18.831528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05068fb0-de5b-4936-9d42-cb60474a953a admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:18.846543 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1404/2837] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:18 2022] PUT /identity/v3/projects/4c0d1513308f4289b4dd382e3358d523/users/afd95c6ec82547a5b567392089e41279/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:18.913991 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4100-de47-4dbb-ae55-777c204b5d67 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:18.914266 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4100-de47-4dbb-ae55-777c204b5d67 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:18.914546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb4100-de47-4dbb-ae55-777c204b5d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:18.943809 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-2ddb4100-de47-4dbb-ae55-777c204b5d67 None None] MFA Rules not processed for user `afd95c6ec82547a5b567392089e41279`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:18.944955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2ddb4100-de47-4dbb-ae55-777c204b5d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:19.015708 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1434/2838] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:19.020716 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05068fb0-de5b-4936-9d42-cb60474a953a admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:19.025646 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:19.090677 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05068fb0-de5b-4936-9d42-cb60474a953a admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:19.096311 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec1ba0-3be8-4a79-9240-fd8b11d1c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:19.097013 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec1ba0-3be8-4a79-9240-fd8b11d1c3ef admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:19.097285 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec1ba0-3be8-4a79-9240-fd8b11d1c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:19.097565 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec1ba0-3be8-4a79-9240-fd8b11d1c3ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:19.098279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec1ba0-3be8-4a79-9240-fd8b11d1c3ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:19.100229 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec1ba0-3be8-4a79-9240-fd8b11d1c3ef admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:19.128223 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1405/2839] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:19 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:19.132706 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb4100-de47-4dbb-ae55-777c204b5d67 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:19.143971 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddb4100-de47-4dbb-ae55-777c204b5d67 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:19.212560 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4968-005a-4b88-af70-c7cbe0465a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:19.213134 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4968-005a-4b88-af70-c7cbe0465a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:19.213412 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4968-005a-4b88-af70-c7cbe0465a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:19.213685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed4968-005a-4b88-af70-c7cbe0465a2b admin admin] PATH_INFO: `/v3/users` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:19.214428 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed4968-005a-4b88-af70-c7cbe0465a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:19.216379 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed4968-005a-4b88-af70-c7cbe0465a2b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:19.237847 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1435/2840] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:19 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:19.242110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec1ba0-3be8-4a79-9240-fd8b11d1c3ef admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:19.252624 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec1ba0-3be8-4a79-9240-fd8b11d1c3ef admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:19.257369 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d897781-04af-4af7-8843-a2c9cd40f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:19.258061 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897781-04af-4af7-8843-a2c9cd40f347 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:19.258332 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897781-04af-4af7-8843-a2c9cd40f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:19.258600 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d897781-04af-4af7-8843-a2c9cd40f347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:19.259325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d897781-04af-4af7-8843-a2c9cd40f347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:19.260940 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d897781-04af-4af7-8843-a2c9cd40f347 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:19.271045 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1406/2841] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:19.275343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4968-005a-4b88-af70-c7cbe0465a2b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:19.285602 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed4968-005a-4b88-af70-c7cbe0465a2b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:19.290641 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b12b39-fc9d-4949-923b-e4c58426b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:19.291515 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b12b39-fc9d-4949-923b-e4c58426b5b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:19.291828 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b12b39-fc9d-4949-923b-e4c58426b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:19.292109 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b12b39-fc9d-4949-923b-e4c58426b5b8 admin admin] PATH_INFO: `/v3/projects/7e0019ffcacf45e4bb990835e9d81f07/users/ed0325f9903d433d8557cc24556c9788/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:19.310292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b12b39-fc9d-4949-923b-e4c58426b5b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0019ffcacf45e4bb990835e9d81f07, user_id=ed0325f9903d433d8557cc24556c9788, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:19.312996 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b12b39-fc9d-4949-923b-e4c58426b5b8 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:19.328386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1436/2842] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:19 2022] PUT /identity/v3/projects/7e0019ffcacf45e4bb990835e9d81f07/users/ed0325f9903d433d8557cc24556c9788/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:19.332632 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d897781-04af-4af7-8843-a2c9cd40f347 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:19.342962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d897781-04af-4af7-8843-a2c9cd40f347 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:19.400535 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece4d4a4-804c-4a9a-8bea-dbe870fc52e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:19.401212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4d4a4-804c-4a9a-8bea-dbe870fc52e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:19.401485 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4d4a4-804c-4a9a-8bea-dbe870fc52e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:19.401753 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece4d4a4-804c-4a9a-8bea-dbe870fc52e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:19.402506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4d4a4-804c-4a9a-8bea-dbe870fc52e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:19.404149 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece4d4a4-804c-4a9a-8bea-dbe870fc52e5 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:19.414079 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1407/2843] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:19.418480 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b12b39-fc9d-4949-923b-e4c58426b5b8 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:19.429141 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b12b39-fc9d-4949-923b-e4c58426b5b8 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:19.434093 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:19.435002 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:19.435281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:19.435550 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] PATH_INFO: `/v3/projects/7e0019ffcacf45e4bb990835e9d81f07/users/ed0325f9903d433d8557cc24556c9788/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:19.437670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0019ffcacf45e4bb990835e9d81f07, user_id=ed0325f9903d433d8557cc24556c9788, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:19.440362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:19.451436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1437/2844] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:19 2022] PUT /identity/v3/projects/7e0019ffcacf45e4bb990835e9d81f07/users/ed0325f9903d433d8557cc24556c9788/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:19.461987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104bd33-e6d7-4f1e-8883-84c83d4e1796 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:19.462318 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104bd33-e6d7-4f1e-8883-84c83d4e1796 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:19.462517 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4104bd33-e6d7-4f1e-8883-84c83d4e1796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:19.489359 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-4104bd33-e6d7-4f1e-8883-84c83d4e1796 None None] MFA Rules not processed for user `ed0325f9903d433d8557cc24556c9788`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:19.490506 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-4104bd33-e6d7-4f1e-8883-84c83d4e1796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:19.557062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:19.562991 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1408/2845] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:19.575333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:19.577523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:19.610191 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:19.640744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66744ee0-aebf-4898-8fb1-b3ee53b6ebc5 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:19.644740 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b99f-d814-4bd8-8497-b3babaffc9fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:19.645457 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b99f-d814-4bd8-8497-b3babaffc9fe service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:19.645744 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b99f-d814-4bd8-8497-b3babaffc9fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:19.646025 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b99f-d814-4bd8-8497-b3babaffc9fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:19.708362 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4b99f-d814-4bd8-8497-b3babaffc9fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:19.710167 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4b99f-d814-4bd8-8497-b3babaffc9fe service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:19.719826 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1438/2846] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:21.220708 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104bd33-e6d7-4f1e-8883-84c83d4e1796 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:21.231636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4104bd33-e6d7-4f1e-8883-84c83d4e1796 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:21.236170 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edd329-10c3-4a5b-8821-faf458742d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:21.236878 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edd329-10c3-4a5b-8821-faf458742d02 service cinder] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:21.237165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edd329-10c3-4a5b-8821-faf458742d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:21.237419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edd329-10c3-4a5b-8821-faf458742d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:21.299856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edd329-10c3-4a5b-8821-faf458742d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:21.301208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76edd329-10c3-4a5b-8821-faf458742d02 service cinder] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:21.310486 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1409/2847] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:21.853432 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b99f-d814-4bd8-8497-b3babaffc9fe service cinder] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:21.862661 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b99f-d814-4bd8-8497-b3babaffc9fe service cinder] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:21.869374 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398fd30-2da5-44f9-8c34-3b05e1151768 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:21.870166 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398fd30-2da5-44f9-8c34-3b05e1151768 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:21.870575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398fd30-2da5-44f9-8c34-3b05e1151768 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:21.870855 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398fd30-2da5-44f9-8c34-3b05e1151768 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:21.881326 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398fd30-2da5-44f9-8c34-3b05e1151768 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:21.882813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398fd30-2da5-44f9-8c34-3b05e1151768 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:21.892507 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1439/2848] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:25.815400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edd329-10c3-4a5b-8821-faf458742d02 service cinder] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:25.889694 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edd329-10c3-4a5b-8821-faf458742d02 service cinder] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:25.894917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:25.895862 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:25.896144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:25.896421 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] PATH_INFO: `/v3/users/a3321ca5096c4086a84bf55f2d46959f` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:25.897762 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3321ca5096c4086a84bf55f2d46959f)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:25.899720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:25.952987 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3321ca5096c4086a84bf55f2d46959f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:25.963024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3321ca5096c4086a84bf55f2d46959f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:25.963876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3321ca5096c4086a84bf55f2d46959f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:25.972234 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3321ca5096c4086a84bf55f2d46959f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:25.984037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3321ca5096c4086a84bf55f2d46959f'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:25.989912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1410/2849] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:25 2022] DELETE /identity/v3/users/a3321ca5096c4086a84bf55f2d46959f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:25.994766 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c763f8-4faa-47ce-bc0a-4c73cb5a2e42 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:25.995327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c763f8-4faa-47ce-bc0a-4c73cb5a2e42 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:25.995327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c763f8-4faa-47ce-bc0a-4c73cb5a2e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:26.014043 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-e0c763f8-4faa-47ce-bc0a-4c73cb5a2e42 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:26.015263 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e0c763f8-4faa-47ce-bc0a-4c73cb5a2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:26.088253 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1440/2850] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:26.095312 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:26.096915 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:26.117791 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:26.162440 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61302714-f879-4d8c-9735-76f5e4d895e6 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:26.166116 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417c10-1470-471d-b1b3-3f8922eba1ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:26.166784 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417c10-1470-471d-b1b3-3f8922eba1ed service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:26.167068 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417c10-1470-471d-b1b3-3f8922eba1ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:26.167342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d417c10-1470-471d-b1b3-3f8922eba1ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:26.177352 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d417c10-1470-471d-b1b3-3f8922eba1ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:26.178826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d417c10-1470-471d-b1b3-3f8922eba1ed service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:26.188459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1411/2851] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:26.477039 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c763f8-4faa-47ce-bc0a-4c73cb5a2e42 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:26.478561 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e0c763f8-4faa-47ce-bc0a-4c73cb5a2e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:26.494208 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c763f8-4faa-47ce-bc0a-4c73cb5a2e42 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:26.499810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:26.500719 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:26.501051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:26.501387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] PATH_INFO: `/v3/projects/9ed1c045fe0e4a3ca864c7d3feeaa3c0` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:26.502928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed1c045fe0e4a3ca864c7d3feeaa3c0)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:26.505117 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:26.557539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed1c045fe0e4a3ca864c7d3feeaa3c0', 'request_id': 'req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.563967 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed1c045fe0e4a3ca864c7d3feeaa3c0', 'request_id': 'req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.573331 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed1c045fe0e4a3ca864c7d3feeaa3c0', 'request_id': 'req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.578257 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:26.586648 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] The token cache is being invalidate because project 9ed1c045fe0e4a3ca864c7d3feeaa3c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:26.586943 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.587858 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.589595 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1441/2852] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:26 2022] DELETE /identity/v3/projects/9ed1c045fe0e4a3ca864c7d3feeaa3c0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:26.593699 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417c10-1470-471d-b1b3-3f8922eba1ed service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:26.604436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d417c10-1470-471d-b1b3-3f8922eba1ed service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:26.671760 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:26.672691 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:26.672970 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:26.673241 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] PATH_INFO: `/v3/users/afd95c6ec82547a5b567392089e41279` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:26.674454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd95c6ec82547a5b567392089e41279)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:26.676425 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:26.728032 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd95c6ec82547a5b567392089e41279'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.737553 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd95c6ec82547a5b567392089e41279'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.738395 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd95c6ec82547a5b567392089e41279'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.749536 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd95c6ec82547a5b567392089e41279'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.762478 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd95c6ec82547a5b567392089e41279'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:26.769562 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1412/2853] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:26 2022] DELETE /identity/v3/users/afd95c6ec82547a5b567392089e41279 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:27.060367 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:27.061846 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:27.081099 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd4e3e-78ac-4b18-b89a-a46f34a4df7c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:27.139144 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:27.140195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:27.140477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:27.140754 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] PATH_INFO: `/v3/projects/4c0d1513308f4289b4dd382e3358d523` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:27.141985 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c0d1513308f4289b4dd382e3358d523)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:27.143915 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:27.193094 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c0d1513308f4289b4dd382e3358d523', 'request_id': 'req-a1bb795f-afdc-49c9-9c4d-11495ec07386'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.199157 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c0d1513308f4289b4dd382e3358d523', 'request_id': 'req-a1bb795f-afdc-49c9-9c4d-11495ec07386'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.208886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c0d1513308f4289b4dd382e3358d523', 'request_id': 'req-a1bb795f-afdc-49c9-9c4d-11495ec07386'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.219817 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] The token cache is being invalidate because project 4c0d1513308f4289b4dd382e3358d523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:27.220387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.221038 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.222714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1442/2854] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:27 2022] DELETE /identity/v3/projects/4c0d1513308f4289b4dd382e3358d523 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:27.227026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:27.228639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:27.242436 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12b222-c985-4ff5-b63d-b2490d44959d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:27.279335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:27.304128 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:27.305015 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:27.305297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:27.305604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] PATH_INFO: `/v3/users/ed0325f9903d433d8557cc24556c9788` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:27.307227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0325f9903d433d8557cc24556c9788)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:27.309293 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:27.362265 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0325f9903d433d8557cc24556c9788'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.370551 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0325f9903d433d8557cc24556c9788'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.371189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0325f9903d433d8557cc24556c9788'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.378217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0325f9903d433d8557cc24556c9788'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.390818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-70d762bf-071b-4f4c-8ea6-3d0a57bcdef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0325f9903d433d8557cc24556c9788'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.397142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1413/2855] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:27 2022] DELETE /identity/v3/users/ed0325f9903d433d8557cc24556c9788 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:27.684514 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:27.686239 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:27.701652 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb795f-afdc-49c9-9c4d-11495ec07386 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:27.766007 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:27.766886 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:27.767168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:27.767442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] PATH_INFO: `/v3/projects/7e0019ffcacf45e4bb990835e9d81f07` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:27.768733 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0019ffcacf45e4bb990835e9d81f07)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:27.770682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:27.806087 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:27.824840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0019ffcacf45e4bb990835e9d81f07', 'request_id': 'req-3a230dbc-e35a-4acc-ba77-9f2b903614b6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.831111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0019ffcacf45e4bb990835e9d81f07', 'request_id': 'req-3a230dbc-e35a-4acc-ba77-9f2b903614b6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.840471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0019ffcacf45e4bb990835e9d81f07', 'request_id': 'req-3a230dbc-e35a-4acc-ba77-9f2b903614b6'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.852033 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] The token cache is being invalidate because project 7e0019ffcacf45e4bb990835e9d81f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:27.852332 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.853005 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-3a230dbc-e35a-4acc-ba77-9f2b903614b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:27.854727 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1443/2856] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:27 2022] DELETE /identity/v3/projects/7e0019ffcacf45e4bb990835e9d81f07 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:27.861016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5e9f-a556-48e8-b44c-a201e7ef0642 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:27.861341 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5e9f-a556-48e8-b44c-a201e7ef0642 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:27.861620 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb5e9f-a556-48e8-b44c-a201e7ef0642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:27.880587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-a4bb5e9f-a556-48e8-b44c-a201e7ef0642 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:27.882014 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a4bb5e9f-a556-48e8-b44c-a201e7ef0642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:27.944491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1414/2857] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:27.957924 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9889a-1ab5-48d4-9def-7ef259a517a4 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:27.958343 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9889a-1ab5-48d4-9def-7ef259a517a4 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:27.958800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b9889a-1ab5-48d4-9def-7ef259a517a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:27.982308 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-39b9889a-1ab5-48d4-9def-7ef259a517a4 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:27.983536 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-39b9889a-1ab5-48d4-9def-7ef259a517a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:27.994370 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1444/2858] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:27.998992 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5e9f-a556-48e8-b44c-a201e7ef0642 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:28.009566 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb5e9f-a556-48e8-b44c-a201e7ef0642 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:28.015054 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:28.015731 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:28.016018 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:28.016294 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:28.017037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:28.017343 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:28.018949 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:28.031449 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1415/2859] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:51:28.035980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9889a-1ab5-48d4-9def-7ef259a517a4 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:28.045756 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b9889a-1ab5-48d4-9def-7ef259a517a4 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:28.050907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c62b-b754-440c-853a-652d5e094f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:28.051534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c62b-b754-440c-853a-652d5e094f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:28.051884 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c62b-b754-440c-853a-652d5e094f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:28.052159 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c62b-b754-440c-853a-652d5e094f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:28.052867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5c62b-b754-440c-853a-652d5e094f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:28.054874 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5c62b-b754-440c-853a-652d5e094f18 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:28.092447 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1445/2860] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:28 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:28.096714 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:28.107335 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0084e6-6fd6-4c46-840c-59b40f5e970c admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:28.149957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:28.171100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e9d6f-134b-4874-9fa3-2f421cb12eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:28.171858 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e9d6f-134b-4874-9fa3-2f421cb12eca admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:28.172142 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e9d6f-134b-4874-9fa3-2f421cb12eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:28.172409 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e9d6f-134b-4874-9fa3-2f421cb12eca admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:28.174052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e9d6f-134b-4874-9fa3-2f421cb12eca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:28.176024 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3e9d6f-134b-4874-9fa3-2f421cb12eca admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:28.201225 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1416/2861] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:28 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:28.205616 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c62b-b754-440c-853a-652d5e094f18 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:28.216488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c62b-b754-440c-853a-652d5e094f18 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:28.221543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a94fe-3d78-4cbf-b883-bc8ba059ed1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:28.222214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a94fe-3d78-4cbf-b883-bc8ba059ed1c admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:28.222494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a94fe-3d78-4cbf-b883-bc8ba059ed1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:28.222769 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117a94fe-3d78-4cbf-b883-bc8ba059ed1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:28.223509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a94fe-3d78-4cbf-b883-bc8ba059ed1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:28.225129 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117a94fe-3d78-4cbf-b883-bc8ba059ed1c admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:28.235108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1446/2862] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:28.239026 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e9d6f-134b-4874-9fa3-2f421cb12eca admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:28.249368 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3e9d6f-134b-4874-9fa3-2f421cb12eca admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:28.254414 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4712c0-3a70-4fd8-91bf-d787aa70ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:28.255075 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4712c0-3a70-4fd8-91bf-d787aa70ecb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:28.255364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4712c0-3a70-4fd8-91bf-d787aa70ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:28.255623 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4712c0-3a70-4fd8-91bf-d787aa70ecb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:28.256495 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4712c0-3a70-4fd8-91bf-d787aa70ecb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:28.258097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4712c0-3a70-4fd8-91bf-d787aa70ecb4 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:28.268995 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1417/2863] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:28.272803 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a94fe-3d78-4cbf-b883-bc8ba059ed1c admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:28.283205 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117a94fe-3d78-4cbf-b883-bc8ba059ed1c admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:28.288604 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:28.289485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:28.289770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:28.290051 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] PATH_INFO: `/v3/projects/05f6317d19124f41953a1ec5b94eb0cb/users/277fdf5ba3104f9ea4f474b25c59dbf1/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:28.305265 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f6317d19124f41953a1ec5b94eb0cb, user_id=277fdf5ba3104f9ea4f474b25c59dbf1, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:28.307906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:28.324015 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1447/2864] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:28 2022] PUT /identity/v3/projects/05f6317d19124f41953a1ec5b94eb0cb/users/277fdf5ba3104f9ea4f474b25c59dbf1/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:28.335801 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56a5cc-812d-49be-9001-7bb04adf2139 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:28.336088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56a5cc-812d-49be-9001-7bb04adf2139 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:28.336364 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56a5cc-812d-49be-9001-7bb04adf2139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:28.363816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-7f56a5cc-812d-49be-9001-7bb04adf2139 None None] MFA Rules not processed for user `277fdf5ba3104f9ea4f474b25c59dbf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:28.365074 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-7f56a5cc-812d-49be-9001-7bb04adf2139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:28.429399 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1418/2865] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:28.440488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:28.442225 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:28.503357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192660-cf67-4565-9472-4ad0d0c62865 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:28.509867 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de9410-c0fc-44c2-94ea-27dcbda9f2d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1df6ff57287645b2ae6f3b68543d6fbf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:28.510647 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de9410-c0fc-44c2-94ea-27dcbda9f2d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:28.511097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de9410-c0fc-44c2-94ea-27dcbda9f2d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:28.511546 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de9410-c0fc-44c2-94ea-27dcbda9f2d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:28.522214 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de9410-c0fc-44c2-94ea-27dcbda9f2d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:28.523607 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de9410-c0fc-44c2-94ea-27dcbda9f2d3 service cinder] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:28.533393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1448/2866] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:38.426701 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:38.528601 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=6,keystone:SELECT=71,keystone:INSERT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:38.603284 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56a5cc-812d-49be-9001-7bb04adf2139 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:38.670009 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56a5cc-812d-49be-9001-7bb04adf2139 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:38.675230 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:38.676144 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:38.676426 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:38.676700 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] PATH_INFO: `/v3/users/277fdf5ba3104f9ea4f474b25c59dbf1` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:38.678019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] RBAC: Authorizing `identity:delete_user(user_id=277fdf5ba3104f9ea4f474b25c59dbf1)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:38.680034 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:38.732981 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277fdf5ba3104f9ea4f474b25c59dbf1'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:38.742408 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277fdf5ba3104f9ea4f474b25c59dbf1'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:38.743058 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277fdf5ba3104f9ea4f474b25c59dbf1'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:38.750876 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277fdf5ba3104f9ea4f474b25c59dbf1'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:38.773196 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277fdf5ba3104f9ea4f474b25c59dbf1'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:38.780089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1419/2867] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:38 2022] DELETE /identity/v3/users/277fdf5ba3104f9ea4f474b25c59dbf1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:38.784825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d30f8-8157-448a-be1d-4fc700ce2f12 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:38.785137 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d30f8-8157-448a-be1d-4fc700ce2f12 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:38.785417 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60d30f8-8157-448a-be1d-4fc700ce2f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:38.804140 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-d60d30f8-8157-448a-be1d-4fc700ce2f12 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:38.805372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d60d30f8-8157-448a-be1d-4fc700ce2f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:38.867685 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1449/2868] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:38.877899 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:38.879458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:38.946783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8676b5e4-5d0c-4df9-9829-174dde5b403d admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:38.951563 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:38.952258 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:38.952521 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:38.952826 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:38.963250 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:38.964718 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:38.975097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1420/2869] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:51:39.281713 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d30f8-8157-448a-be1d-4fc700ce2f12 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:39.284543 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-d60d30f8-8157-448a-be1d-4fc700ce2f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:39.297169 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60d30f8-8157-448a-be1d-4fc700ce2f12 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:39.302485 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:39.303703 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:39.304162 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:39.304481 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] PATH_INFO: `/v3/projects/05f6317d19124f41953a1ec5b94eb0cb` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:39.305880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f6317d19124f41953a1ec5b94eb0cb)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:39.307960 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:39.365725 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f6317d19124f41953a1ec5b94eb0cb', 'request_id': 'req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:39.373410 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f6317d19124f41953a1ec5b94eb0cb', 'request_id': 'req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:39.388120 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f6317d19124f41953a1ec5b94eb0cb', 'request_id': 'req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:39.399986 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] The token cache is being invalidate because project 05f6317d19124f41953a1ec5b94eb0cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:39.400454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:39.401106 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-4b29d30b-ce10-4002-8f26-e1bf95f3ba5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:39.402979 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1450/2870] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:39 2022] DELETE /identity/v3/projects/05f6317d19124f41953a1ec5b94eb0cb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:46.462019 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:46.463707 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:46.477639 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fad4e-c229-4bbb-b0c9-243663a3376a service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:46.497602 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:46.539113 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:46.540028 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:46.540310 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:46.540585 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] PATH_INFO: `/v3/users/19bc78c4df3841bb8fa2f5344def326b` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:46.541847 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19bc78c4df3841bb8fa2f5344def326b)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:46.543821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:46.594069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19bc78c4df3841bb8fa2f5344def326b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:46.605498 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19bc78c4df3841bb8fa2f5344def326b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:46.606576 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19bc78c4df3841bb8fa2f5344def326b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:46.614197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19bc78c4df3841bb8fa2f5344def326b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:46.627558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19bc78c4df3841bb8fa2f5344def326b'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:46.634435 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1421/2871] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:51:46 2022] DELETE /identity/v3/users/19bc78c4df3841bb8fa2f5344def326b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:46.639634 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e4df-2365-4b6f-afba-b247b04c717c None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:46.640125 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e4df-2365-4b6f-afba-b247b04c717c None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:46.640222 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237e4df-2365-4b6f-afba-b247b04c717c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:46.658922 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-7237e4df-2365-4b6f-afba-b247b04c717c None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:46.660152 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7237e4df-2365-4b6f-afba-b247b04c717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:46.730751 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1451/2872] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:46.741320 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:46.743998 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:46.805366 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef4604-8aef-412e-81a7-719f4bc83e0e admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:46.809528 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62813f3e-df29-414f-9fdb-1597fd1a87d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:46.810175 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813f3e-df29-414f-9fdb-1597fd1a87d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:46.810454 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813f3e-df29-414f-9fdb-1597fd1a87d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:46.810783 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62813f3e-df29-414f-9fdb-1597fd1a87d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:46.822505 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62813f3e-df29-414f-9fdb-1597fd1a87d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:46.824297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62813f3e-df29-414f-9fdb-1597fd1a87d0 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:46.833926 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1422/2873] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:47.121676 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237e4df-2365-4b6f-afba-b247b04c717c None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:47.123153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-7237e4df-2365-4b6f-afba-b247b04c717c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:47.136072 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237e4df-2365-4b6f-afba-b247b04c717c None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:47.141569 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:47.142459 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.142748 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.143029 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] PATH_INFO: `/v3/projects/27fb400d75fa43ceb4f11d7a5af73d41` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.144333 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fb400d75fa43ceb4f11d7a5af73d41)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:47.146354 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:47.168512 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:47.195984 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fb400d75fa43ceb4f11d7a5af73d41', 'request_id': 'req-9172defe-cf4d-497c-af89-4c5beda99322'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:47.202611 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fb400d75fa43ceb4f11d7a5af73d41', 'request_id': 'req-9172defe-cf4d-497c-af89-4c5beda99322'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:47.212494 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fb400d75fa43ceb4f11d7a5af73d41', 'request_id': 'req-9172defe-cf4d-497c-af89-4c5beda99322'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:47.222853 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] The token cache is being invalidate because project 27fb400d75fa43ceb4f11d7a5af73d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:51:47.223139 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:47.223800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-9172defe-cf4d-497c-af89-4c5beda99322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:51:47.225365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1452/2874] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:51:47 2022] DELETE /identity/v3/projects/27fb400d75fa43ceb4f11d7a5af73d41 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:47.230367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f5585-9dbe-4b8e-80e2-acdafe401554 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.230653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f5585-9dbe-4b8e-80e2-acdafe401554 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.230957 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490f5585-9dbe-4b8e-80e2-acdafe401554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.248612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-490f5585-9dbe-4b8e-80e2-acdafe401554 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:47.249773 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-490f5585-9dbe-4b8e-80e2-acdafe401554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:47.289822 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:47.309695 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1423/2875] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:47.317807 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ba502-cfc4-4e93-8d76-5b482c7c52bf None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.318097 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ba502-cfc4-4e93-8d76-5b482c7c52bf None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.318358 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ba502-cfc4-4e93-8d76-5b482c7c52bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.337477 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-b72ba502-cfc4-4e93-8d76-5b482c7c52bf None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:47.338691 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-b72ba502-cfc4-4e93-8d76-5b482c7c52bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:47.347003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1453/2876] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:47.351132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f5585-9dbe-4b8e-80e2-acdafe401554 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:47.361537 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490f5585-9dbe-4b8e-80e2-acdafe401554 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:47.367816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:47.368670 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.369091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.369401 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] PATH_INFO: `/v3/domains` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.370146 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80482) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 13:51:47.370458 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:47.372402 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:47.384976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1424/2877] 10.222.0.64 () {58 vars in 1152 bytes} [Tue Jul 12 13:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 13:51:47.389499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ba502-cfc4-4e93-8d76-5b482c7c52bf None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:47.399363 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ba502-cfc4-4e93-8d76-5b482c7c52bf None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:47.405387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd6a5a-0e0e-4c82-8f82-7f33178b2056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:47.406046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd6a5a-0e0e-4c82-8f82-7f33178b2056 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.406323 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd6a5a-0e0e-4c82-8f82-7f33178b2056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.406597 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fd6a5a-0e0e-4c82-8f82-7f33178b2056 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.407293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd6a5a-0e0e-4c82-8f82-7f33178b2056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:47.409209 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fd6a5a-0e0e-4c82-8f82-7f33178b2056 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:47.438382 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1454/2878] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:47 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 13:51:47.442594 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:47.453391 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108ffcc-4811-44c6-884d-d2bea6f45aac admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:47.512376 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12075c95-80aa-49cc-baeb-340f4f915f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:47.513031 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075c95-80aa-49cc-baeb-340f4f915f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.513235 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075c95-80aa-49cc-baeb-340f4f915f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.513504 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12075c95-80aa-49cc-baeb-340f4f915f59 admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.514212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12075c95-80aa-49cc-baeb-340f4f915f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:47.516145 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12075c95-80aa-49cc-baeb-340f4f915f59 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:47.539221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1425/2879] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:47 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:47.543385 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd6a5a-0e0e-4c82-8f82-7f33178b2056 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:47.553959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fd6a5a-0e0e-4c82-8f82-7f33178b2056 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:47.559118 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980095af-cd01-4a05-a28f-9fecae4cb883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:47.559824 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980095af-cd01-4a05-a28f-9fecae4cb883 admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.560108 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980095af-cd01-4a05-a28f-9fecae4cb883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.560388 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980095af-cd01-4a05-a28f-9fecae4cb883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.561174 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980095af-cd01-4a05-a28f-9fecae4cb883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:47.562755 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980095af-cd01-4a05-a28f-9fecae4cb883 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:47.573509 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1455/2880] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:47.577651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12075c95-80aa-49cc-baeb-340f4f915f59 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:47.587958 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12075c95-80aa-49cc-baeb-340f4f915f59 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:47.593487 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15173586-6b75-4384-be89-3cf30c1745a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:47.594147 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173586-6b75-4384-be89-3cf30c1745a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.594428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173586-6b75-4384-be89-3cf30c1745a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.594703 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15173586-6b75-4384-be89-3cf30c1745a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.595459 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173586-6b75-4384-be89-3cf30c1745a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:47.597046 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15173586-6b75-4384-be89-3cf30c1745a7 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:47.607177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1426/2881] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:47.611235 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980095af-cd01-4a05-a28f-9fecae4cb883 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:47.621442 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980095af-cd01-4a05-a28f-9fecae4cb883 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:47.626317 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:47.627200 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.627454 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.627794 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] PATH_INFO: `/v3/projects/ff84397ed484442090548292fe5a959f/users/c7db3f244b7e400cbc935a41b5b83d13/roles/edb5b1408bc94aefa62e360a44fa0940` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.642195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff84397ed484442090548292fe5a959f, user_id=c7db3f244b7e400cbc935a41b5b83d13, role_id=edb5b1408bc94aefa62e360a44fa0940)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:47.644876 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:47.660368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1456/2882] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:47 2022] PUT /identity/v3/projects/ff84397ed484442090548292fe5a959f/users/c7db3f244b7e400cbc935a41b5b83d13/roles/edb5b1408bc94aefa62e360a44fa0940 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:51:47.665803 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b5769-cefc-471f-807d-7a14f4ebbd66 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.666095 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b5769-cefc-471f-807d-7a14f4ebbd66 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.666394 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b5769-cefc-471f-807d-7a14f4ebbd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.684492 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-ff1b5769-cefc-471f-807d-7a14f4ebbd66 None None] MFA Rules not processed for user `3b4c5b191aab43d1b1bbd3832a632cc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:47.685799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-ff1b5769-cefc-471f-807d-7a14f4ebbd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:47.748134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1427/2883] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:47.759433 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:47.761488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:47.831075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a091203-1b7f-481e-b784-669ff54fb9b9 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:47.835089 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eec7c3-82bf-4c36-ab03-6d1c66d680b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:47.835772 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec7c3-82bf-4c36-ab03-6d1c66d680b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:47.836054 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec7c3-82bf-4c36-ab03-6d1c66d680b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:47.836322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec7c3-82bf-4c36-ab03-6d1c66d680b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:47.846142 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eec7c3-82bf-4c36-ab03-6d1c66d680b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:47.847575 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eec7c3-82bf-4c36-ab03-6d1c66d680b0 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:47.857289 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1457/2884] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:51.686083 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbb201-5af2-46a4-996f-1b82be7b814d None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:51.686662 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbb201-5af2-46a4-996f-1b82be7b814d None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:51.686662 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbbb201-5af2-46a4-996f-1b82be7b814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:51.716881 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-acbbb201-5af2-46a4-996f-1b82be7b814d None None] MFA Rules not processed for user `c7db3f244b7e400cbc935a41b5b83d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:51.718742 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-acbbb201-5af2-46a4-996f-1b82be7b814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:51.774558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:51.805165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1428/2885] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:51.810429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eec7c3-82bf-4c36-ab03-6d1c66d680b0 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:51.821729 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eec7c3-82bf-4c36-ab03-6d1c66d680b0 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:51.826906 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f763-fe7d-4393-a0c3-aa890b7a1231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:51.827581 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f763-fe7d-4393-a0c3-aa890b7a1231 admin admin] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:51.827897 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f763-fe7d-4393-a0c3-aa890b7a1231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:51.828176 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506f763-fe7d-4393-a0c3-aa890b7a1231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:51.828879 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506f763-fe7d-4393-a0c3-aa890b7a1231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:51.830799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c506f763-fe7d-4393-a0c3-aa890b7a1231 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:51.859765 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1458/2886] 10.222.0.64 () {60 vars in 1152 bytes} [Tue Jul 12 13:51:51 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:51.864154 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbb201-5af2-46a4-996f-1b82be7b814d None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:51.876097 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbbb201-5af2-46a4-996f-1b82be7b814d None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:51.943025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e91c-9330-4acf-a254-7f547e6a9adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:51.943769 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e91c-9330-4acf-a254-7f547e6a9adb admin admin] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:51.944237 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e91c-9330-4acf-a254-7f547e6a9adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:51.944353 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f19e91c-9330-4acf-a254-7f547e6a9adb admin admin] PATH_INFO: `/v3/users` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:51.945100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e91c-9330-4acf-a254-7f547e6a9adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:51.947064 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f19e91c-9330-4acf-a254-7f547e6a9adb admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:51.971785 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1429/2887] 10.222.0.64 () {60 vars in 1143 bytes} [Tue Jul 12 13:51:51 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 13:51:51.973862 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f763-fe7d-4393-a0c3-aa890b7a1231 admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:51.985800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506f763-fe7d-4393-a0c3-aa890b7a1231 admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:51.992535 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442cf59-638c-4cfb-8ba4-a64819c942ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:51.993322 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442cf59-638c-4cfb-8ba4-a64819c942ac admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:51.993799 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442cf59-638c-4cfb-8ba4-a64819c942ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:51.994357 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5442cf59-638c-4cfb-8ba4-a64819c942ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:51.995840 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442cf59-638c-4cfb-8ba4-a64819c942ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:51.997483 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5442cf59-638c-4cfb-8ba4-a64819c942ac admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:52.011085 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1459/2888] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:52.015737 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e91c-9330-4acf-a254-7f547e6a9adb admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:52.030912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f19e91c-9330-4acf-a254-7f547e6a9adb admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:52.035819 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287432f1-2dc3-4a15-ba32-90ca2db9acf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:52.036832 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287432f1-2dc3-4a15-ba32-90ca2db9acf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:52.037180 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287432f1-2dc3-4a15-ba32-90ca2db9acf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:52.037552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287432f1-2dc3-4a15-ba32-90ca2db9acf6 admin admin] PATH_INFO: `/v3/projects/45da1df31c404c8bb8ed9c4271d47471/users/b9592019c9da412e976e628251234284/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:52.057367 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287432f1-2dc3-4a15-ba32-90ca2db9acf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45da1df31c404c8bb8ed9c4271d47471, user_id=b9592019c9da412e976e628251234284, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:52.060362 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287432f1-2dc3-4a15-ba32-90ca2db9acf6 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:52.076706 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1430/2889] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:52 2022] PUT /identity/v3/projects/45da1df31c404c8bb8ed9c4271d47471/users/b9592019c9da412e976e628251234284/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:52.084302 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442cf59-638c-4cfb-8ba4-a64819c942ac admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:52.094736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5442cf59-638c-4cfb-8ba4-a64819c942ac admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:52.105030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:52.165559 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e6125-920d-40e6-b9aa-9ea6f5cb887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:52.166259 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e6125-920d-40e6-b9aa-9ea6f5cb887f admin admin] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:52.166537 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e6125-920d-40e6-b9aa-9ea6f5cb887f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:52.166808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e6125-920d-40e6-b9aa-9ea6f5cb887f admin admin] PATH_INFO: `/v3/roles` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:52.167651 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e6125-920d-40e6-b9aa-9ea6f5cb887f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:52.169372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e6125-920d-40e6-b9aa-9ea6f5cb887f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:52.183292 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1460/2890] 10.222.0.64 () {58 vars in 1121 bytes} [Tue Jul 12 13:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 13:51:52.184610 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287432f1-2dc3-4a15-ba32-90ca2db9acf6 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:52.196821 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287432f1-2dc3-4a15-ba32-90ca2db9acf6 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:52.202197 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:52.203206 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:52.203488 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:52.203799 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] PATH_INFO: `/v3/projects/45da1df31c404c8bb8ed9c4271d47471/users/b9592019c9da412e976e628251234284/roles/f673c3a045e14e8eaaaca80a4c07267e` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:52.205849 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45da1df31c404c8bb8ed9c4271d47471, user_id=b9592019c9da412e976e628251234284, role_id=f673c3a045e14e8eaaaca80a4c07267e)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:52.208507 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:52.224012 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1431/2891] 10.222.0.64 () {60 vars in 1482 bytes} [Tue Jul 12 13:51:52 2022] PUT /identity/v3/projects/45da1df31c404c8bb8ed9c4271d47471/users/b9592019c9da412e976e628251234284/roles/f673c3a045e14e8eaaaca80a4c07267e => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:51:56.951436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713aaa-46cf-40db-b2f9-dd1814f23dd1 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:56.951988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713aaa-46cf-40db-b2f9-dd1814f23dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:56.951988 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e713aaa-46cf-40db-b2f9-dd1814f23dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:56.981030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-8e713aaa-46cf-40db-b2f9-dd1814f23dd1 None None] MFA Rules not processed for user `b9592019c9da412e976e628251234284`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:56.982568 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-8e713aaa-46cf-40db-b2f9-dd1814f23dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:57.054153 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1461/2892] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:51:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:57.066558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:57.068448 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:57.134722 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bf2a4-ff57-4c1b-9ea2-c7c521dbd140 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:57.138452 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:57.139771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:57.139771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:57.139771 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:57.190775 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:51:57.204913 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:57.206397 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:57.216110 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1432/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:51:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:51:57.320403 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dcaf5-2599-4d24-8162-83d803d9503e None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:57.320694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dcaf5-2599-4d24-8162-83d803d9503e None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:57.320973 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dcaf5-2599-4d24-8162-83d803d9503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:57.376904 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-880dcaf5-2599-4d24-8162-83d803d9503e None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:51:57.378175 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-880dcaf5-2599-4d24-8162-83d803d9503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:57.448598 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1462/2894] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:51:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:51:57.505892 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:51:57.508342 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:51:57.610400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6c74b-9911-4e92-9d03-e86ea8cca5a1 service glance] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:51:57.616429 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242273a0-55bc-431c-9273-8958bda1a6ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:51:57.617111 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242273a0-55bc-431c-9273-8958bda1a6ee service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:51:57.617524 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242273a0-55bc-431c-9273-8958bda1a6ee service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:51:57.617661 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242273a0-55bc-431c-9273-8958bda1a6ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:51:57.626901 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242273a0-55bc-431c-9273-8958bda1a6ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:51:57.628529 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242273a0-55bc-431c-9273-8958bda1a6ee service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:51:57.637297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1433/2895] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:51:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:52:06.086387 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71de63-f6a8-4588-ab0d-e4df10c19598 None None] REQUEST_METHOD: `POST` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:06.086928 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71de63-f6a8-4588-ab0d-e4df10c19598 None None] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:06.087030 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca71de63-f6a8-4588-ab0d-e4df10c19598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:06.099539 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:06.105542 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.auth.core [None req-ca71de63-f6a8-4588-ab0d-e4df10c19598 None None] MFA Rules not processed for user `c7db3f244b7e400cbc935a41b5b83d13`. Rule list: `[]` (Enabled: `True`). {{(pid=80481) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:52:06.106825 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ca71de63-f6a8-4588-ab0d-e4df10c19598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:06.114022 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1463/2896] 10.222.0.64 () {58 vars in 957 bytes} [Tue Jul 12 13:52:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:52:06.151253 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242273a0-55bc-431c-9273-8958bda1a6ee service swift] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:52:06.161809 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242273a0-55bc-431c-9273-8958bda1a6ee service swift] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:52:06.166308 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1dd830b8f7846e78d8f007ac436d95b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:52:06.166993 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:06.167283 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:06.167558 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:06.169628 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:06.245400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:52:06.246845 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:52:06.258106 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1434/2897] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:52:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:52:06.809770 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71de63-f6a8-4588-ab0d-e4df10c19598 None None] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:52:06.811386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-ca71de63-f6a8-4588-ab0d-e4df10c19598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:06.815656 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:52:06.863048 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=100 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:06.874653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d66b8d-416d-4b6e-80e4-6fa3593e0561 service glance] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:52:06.878651 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89900fe3-dc60-4c01-bf9d-1a3b6eecb951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:52:06.879297 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89900fe3-dc60-4c01-bf9d-1a3b6eecb951 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:06.879579 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89900fe3-dc60-4c01-bf9d-1a3b6eecb951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:06.879882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89900fe3-dc60-4c01-bf9d-1a3b6eecb951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:06.881794 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-89900fe3-dc60-4c01-bf9d-1a3b6eecb951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:06.883688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca71de63-f6a8-4588-ab0d-e4df10c19598 None None] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:52:06.888736 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:52:06.889383 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:06.889663 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:06.889941 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:06.891714 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:06.896612 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89900fe3-dc60-4c01-bf9d-1a3b6eecb951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:52:06.898059 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89900fe3-dc60-4c01-bf9d-1a3b6eecb951 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:52:06.904580 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:52:06.906132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:52:06.909776 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1435/2898] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:52:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 13:52:06.917339 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1464/2899] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:52:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:52:08.278262 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdfe6e-8037-4f4b-a9c4-49e9042385da None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:08.278763 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdfe6e-8037-4f4b-a9c4-49e9042385da None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:08.279025 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bdfe6e-8037-4f4b-a9c4-49e9042385da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:08.296917 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-d1bdfe6e-8037-4f4b-a9c4-49e9042385da None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:52:08.298204 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d1bdfe6e-8037-4f4b-a9c4-49e9042385da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:08.305883 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1436/2900] 10.222.0.64 () {58 vars in 1009 bytes} [Tue Jul 12 13:52:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 13:52:08.319130 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:52:08.331233 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ae9c6-90a1-4c93-a1ff-8ab52451fecb service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:52:08.336591 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:52:08.337247 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:08.337527 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:08.337810 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:08.346673 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:52:08.348434 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:52:08.357246 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1465/2901] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:52:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 13:52:18.292069 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=10 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:18.354012 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=38 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:18.693931 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdfe6e-8037-4f4b-a9c4-49e9042385da None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:52:18.695552 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-d1bdfe6e-8037-4f4b-a9c4-49e9042385da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:18.707457 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bdfe6e-8037-4f4b-a9c4-49e9042385da None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:52:18.711174 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:52:18.711885 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:18.712165 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:18.712437 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:18.714309 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:18.724501 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:52:18.725963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:52:18.734277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1437/2902] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:52:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:52:19.375081 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:52:19.376672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:19.395188 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3bb7e-0f72-4a1b-b79a-75162976d6d0 service swift] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:52:19.401314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:52:19.401950 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:19.402212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:19.402631 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:19.404688 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:19.418658 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:52:19.420540 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:52:19.432547 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1466/2903] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:52:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:52:28.730534 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=6 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:29.427427 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:32.983636 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:52:32.995428 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cff55-be86-4e8f-8b35-16e47d4d0e86 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:52:32.999400 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e478765-3c6f-4bf9-9690-d5eac4e035a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:52:33.000132 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e478765-3c6f-4bf9-9690-d5eac4e035a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:33.000445 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e478765-3c6f-4bf9-9690-d5eac4e035a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:33.000870 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e478765-3c6f-4bf9-9690-d5eac4e035a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:33.010988 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e478765-3c6f-4bf9-9690-d5eac4e035a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:52:33.012460 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e478765-3c6f-4bf9-9690-d5eac4e035a2 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:52:33.022709 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1438/2904] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:52:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:52:34.695337 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:52:34.709327 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad0661-044f-4c91-aecf-806b8d6e7f8d service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:52:34.717692 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:52:34.718566 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:52:34.719046 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:52:34.719499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:52:34.722124 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:52:34.736368 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:52:34.738351 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:52:34.752461 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1467/2905] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:52:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:52:43.018410 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=6 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:52:44.746962 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:53:06.964720 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e478765-3c6f-4bf9-9690-d5eac4e035a2 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:53:06.974721 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e478765-3c6f-4bf9-9690-d5eac4e035a2 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:53:06.978976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:53:06.979635 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:53:06.979941 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:53:06.980217 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:53:06.982089 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:53:06.992390 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:53:06.993868 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:53:07.002212 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1439/2906] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:53:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:53:07.099393 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:53:07.108834 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495edfc6-8ee8-43a0-b8b0-92af255fb20c service nova] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:53:07.112538 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:53:07.113182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:53:07.113491 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:53:07.113734 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:53:07.115635 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:53:07.132077 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:53:07.134281 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:53:07.151242 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1468/2907] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:53:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:53:09.712796 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:53:09.715020 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:53:09.734351 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a6abf-3c65-463c-8624-e68c92af49e9 service neutron] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:53:09.741208 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6eb064e8062d4a4eb7a7974f7200c86f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:53:09.741867 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:53:09.742193 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:53:09.742475 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:53:09.744374 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:53:09.759617 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:53:09.761615 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:53:09.772816 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1440/2908] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:53:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:53:17.144212 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=6 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:53:19.768334 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=12 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:54:57.686111 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:54:57.696880 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9d7f4-056b-43ac-b3d0-748d5b2ff229 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:54:57.701013 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:54:57.701812 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:54:57.702244 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:54:57.702524 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:54:57.704436 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:54:57.778872 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:54:57.780373 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:54:57.789800 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1469/2909] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:54:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:55:01.992219 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:02.004088 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593aab37-6c02-47b0-8b84-95835d3b7086 service nova] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:02.010354 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2291bc81-4059-4e33-bdfb-bc81aabc807c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:02.011000 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291bc81-4059-4e33-bdfb-bc81aabc807c service placement] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:02.011279 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291bc81-4059-4e33-bdfb-bc81aabc807c service placement] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:02.011550 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2291bc81-4059-4e33-bdfb-bc81aabc807c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:02.013587 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-2291bc81-4059-4e33-bdfb-bc81aabc807c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:02.025818 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291bc81-4059-4e33-bdfb-bc81aabc807c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:02.028935 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2291bc81-4059-4e33-bdfb-bc81aabc807c service placement] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:02.042233 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1441/2910] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:55:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:55:03.863926 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:03.871100 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bb2e5-9cc7-4986-aacd-6319ccbdf7f9 None None] REQUEST_METHOD: `POST` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:03.871653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bb2e5-9cc7-4986-aacd-6319ccbdf7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:03.871653 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665bb2e5-9cc7-4986-aacd-6319ccbdf7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:03.874372 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2758-0c4b-4ffe-a3c9-fdb200d13e61 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:03.878523 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcdda7fcb39248c1a5a36ee699d23c73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:03.879199 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:03.880687 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:03.881145 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:03.883682 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:03.891745 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.auth.core [None req-665bb2e5-9cc7-4986-aacd-6319ccbdf7f9 None None] MFA Rules not processed for user `7a35fb3434e64a259e8b9938ef38b32f`. Rule list: `[]` (Enabled: `True`). {{(pid=80482) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 13:55:03.893091 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-665bb2e5-9cc7-4986-aacd-6319ccbdf7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:03.900542 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1442/2911] 10.222.0.64 () {58 vars in 967 bytes} [Tue Jul 12 13:55:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 13:55:03.944674 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bb2e5-9cc7-4986-aacd-6319ccbdf7f9 None None] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:03.953573 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:03.955008 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:03.957150 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665bb2e5-9cc7-4986-aacd-6319ccbdf7f9 None None] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:03.962326 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a57f6f39bba04a9d80a885340239cea3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:03.962976 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] REQUEST_METHOD: `GET` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:03.963259 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:03.963533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:03.964670 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1470/2912] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:55:03.972181 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:03.973761 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:03.982123 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1443/2913] 10.222.0.64 () {60 vars in 1384 bytes} [Tue Jul 12 13:55:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 13:55:08.706500 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:08.729264 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c2ea63-24ee-4fb5-a967-f5d60a5856f5 service neutron] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:08.737971 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d373d537efc44de9382e6c4cdaf6e55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f76112e485294c4b9bf19c4ec562e81e', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:08.741201 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] REQUEST_METHOD: `GET` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:08.741762 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:08.742296 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:08.751386 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:08.776534 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:08.784047 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:08.808982 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1471/2914] 10.222.0.64 () {60 vars in 1365 bytes} [Tue Jul 12 13:55:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 13:55:13.229887 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:13.231642 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:13.248880 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eb902-ea56-4b02-b5c5-6fb39579bd1e service swift] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:13.254533 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:13.256052 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:13.256519 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:13.257037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] PATH_INFO: `/v3/users/b00dad2048064a0185653630b5511b06` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:13.258543 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b00dad2048064a0185653630b5511b06)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:13.262277 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:13.331503 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b00dad2048064a0185653630b5511b06'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.340419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b00dad2048064a0185653630b5511b06'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.341559 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b00dad2048064a0185653630b5511b06'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.352947 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b00dad2048064a0185653630b5511b06'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.368168 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b00dad2048064a0185653630b5511b06'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.375037 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1444/2915] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:55:13 2022] DELETE /identity/v3/users/b00dad2048064a0185653630b5511b06 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:55:13.560694 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:13.577132 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b93-c48d-4cbc-ad61-8ae0995f4604 service placement] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:13.675348 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:13.676301 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:13.676576 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:13.676907 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] PATH_INFO: `/v3/projects/150666bb3f374b7095b1ad0dd923a65e` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:13.678156 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] RBAC: Authorizing `identity:delete_project(project_id=150666bb3f374b7095b1ad0dd923a65e)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:13.680121 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:13.710739 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:13.711075 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=100 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:55:13.712491 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:13.728568 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913d706-c816-471b-941b-cfe73a5c5f01 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:13.741195 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '150666bb3f374b7095b1ad0dd923a65e', 'request_id': 'req-13aded52-e8f4-40b6-a9c4-c002460a390f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.747452 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '150666bb3f374b7095b1ad0dd923a65e', 'request_id': 'req-13aded52-e8f4-40b6-a9c4-c002460a390f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.755981 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '150666bb3f374b7095b1ad0dd923a65e', 'request_id': 'req-13aded52-e8f4-40b6-a9c4-c002460a390f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.766499 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] The token cache is being invalidate because project 150666bb3f374b7095b1ad0dd923a65e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:55:13.766792 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.767430 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.769182 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1472/2916] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:55:13 2022] DELETE /identity/v3/projects/150666bb3f374b7095b1ad0dd923a65e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:55:13.772956 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:13.774256 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:13.788434 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:13.789325 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:13.789613 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:13.789893 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] PATH_INFO: `/v3/users/c7db3f244b7e400cbc935a41b5b83d13` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:13.791129 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7db3f244b7e400cbc935a41b5b83d13)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:13.793126 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:13.838010 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:55:13.838917 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aded52-e8f4-40b6-a9c4-c002460a390f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:13.843804 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7db3f244b7e400cbc935a41b5b83d13'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.843980 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:13.844672 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:13.844955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:13.845231 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] PATH_INFO: `/v3/users/174971069f8a4f66b2f45a861226a3e9` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:13.846572 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] RBAC: Authorizing `identity:delete_user(user_id=174971069f8a4f66b2f45a861226a3e9)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:13.848753 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:13.852222 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7db3f244b7e400cbc935a41b5b83d13'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.852888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7db3f244b7e400cbc935a41b5b83d13'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.859983 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7db3f244b7e400cbc935a41b5b83d13'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.871912 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7db3f244b7e400cbc935a41b5b83d13'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.878266 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1445/2917] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:55:13 2022] DELETE /identity/v3/users/c7db3f244b7e400cbc935a41b5b83d13 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:55:13.901639 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174971069f8a4f66b2f45a861226a3e9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.902314 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174971069f8a4f66b2f45a861226a3e9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.910389 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174971069f8a4f66b2f45a861226a3e9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.917859 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174971069f8a4f66b2f45a861226a3e9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.918464 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174971069f8a4f66b2f45a861226a3e9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:13.938903 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1473/2918] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:55:13 2022] DELETE /identity/v3/users/174971069f8a4f66b2f45a861226a3e9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:55:14.069645 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:14.073856 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:14.149293 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:14.150721 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:14.169604 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e03598-dd0f-4d93-8b2e-7577cd749411 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:14.190180 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:55:14.234062 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:14.235688 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:14.235962 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:14.236227 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] PATH_INFO: `/v3/projects/ff84397ed484442090548292fe5a959f` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:14.237062 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae6049-854f-41fd-8e74-76b2e19f232b admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:14.237483 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff84397ed484442090548292fe5a959f)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:14.239442 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:14.241684 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:14.242563 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:14.242844 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:14.243122 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] PATH_INFO: `/v3/projects/a69b7b59d1b94c9e97f6fddb0a804e55` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:14.244341 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69b7b59d1b94c9e97f6fddb0a804e55)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:14.246250 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:14.290016 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff84397ed484442090548292fe5a959f', 'request_id': 'req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.298002 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff84397ed484442090548292fe5a959f', 'request_id': 'req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.304139 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff84397ed484442090548292fe5a959f', 'request_id': 'req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.304471 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69b7b59d1b94c9e97f6fddb0a804e55', 'request_id': 'req-cc60247d-9b9d-4565-963f-3ed78d29609f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.306807 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:55:14.310939 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69b7b59d1b94c9e97f6fddb0a804e55', 'request_id': 'req-cc60247d-9b9d-4565-963f-3ed78d29609f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.318030 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] The token cache is being invalidate because project ff84397ed484442090548292fe5a959f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80482) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:55:14.318313 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.319813 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69b7b59d1b94c9e97f6fddb0a804e55', 'request_id': 'req-cc60247d-9b9d-4565-963f-3ed78d29609f'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.319963 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.322134 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1446/2919] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:55:14 2022] DELETE /identity/v3/projects/ff84397ed484442090548292fe5a959f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:55:14.325888 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] Authenticating user token {{(pid=80482) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:14.327177 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.fernet_utils [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80482) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:14.334066 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] The token cache is being invalidate because project a69b7b59d1b94c9e97f6fddb0a804e55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:55:14.334361 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.335003 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.336808 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1474/2920] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:55:14 2022] DELETE /identity/v3/projects/a69b7b59d1b94c9e97f6fddb0a804e55 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:55:14.395657 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b7aaa-3a6f-4d15-835f-1f0f2b3b45a0 admin admin] Validating token access rules against request {{(pid=80482) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:14.458658 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80482) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:14.459567 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:14.459882 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:14.460157 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] PATH_INFO: `/v3/users/b9592019c9da412e976e628251234284` {{(pid=80482) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:14.461481 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9592019c9da412e976e628251234284)` {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:14.463419 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] RBAC: Authorization granted {{(pid=80482) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:14.516221 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9592019c9da412e976e628251234284'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.524996 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9592019c9da412e976e628251234284'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.525841 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9592019c9da412e976e628251234284'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.534189 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9592019c9da412e976e628251234284'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.549321 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG keystone.notifications [None req-20daa069-2918-42eb-acec-7f45b0556caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9592019c9da412e976e628251234284'} {{(pid=80482) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.556271 dv-cinder-797970-4-smb devstack@keystone.service[80482]: [pid: 80482|app: 0|req: 1447/2921] 10.222.0.64 () {58 vars in 1223 bytes} [Tue Jul 12 13:55:14 2022] DELETE /identity/v3/users/b9592019c9da412e976e628251234284 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 13:55:14.737365 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] Authenticating user token {{(pid=80481) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 13:55:14.738955 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.fernet_utils [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80481) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 13:55:14.752328 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc60247d-9b9d-4565-963f-3ed78d29609f admin admin] Validating token access rules against request {{(pid=80481) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 13:55:14.810168 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b4c5b191aab43d1b1bbd3832a632cc1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0d8758be35b84eb491917415afdbf67c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80481) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 13:55:14.810959 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 13:55:14.811236 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 13:55:14.811488 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] PATH_INFO: `/v3/projects/45da1df31c404c8bb8ed9c4271d47471` {{(pid=80481) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 13:55:14.812723 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45da1df31c404c8bb8ed9c4271d47471)` {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 13:55:14.814640 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] RBAC: Authorization granted {{(pid=80481) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 13:55:14.863945 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45da1df31c404c8bb8ed9c4271d47471', 'request_id': 'req-869a95c5-6f40-4a82-aad9-4e3e342368f9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.870355 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45da1df31c404c8bb8ed9c4271d47471', 'request_id': 'req-869a95c5-6f40-4a82-aad9-4e3e342368f9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.878898 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45da1df31c404c8bb8ed9c4271d47471', 'request_id': 'req-869a95c5-6f40-4a82-aad9-4e3e342368f9'} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.880223 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:55:14.891946 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] The token cache is being invalidate because project 45da1df31c404c8bb8ed9c4271d47471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80481) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 13:55:14.892238 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.892891 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG keystone.notifications [None req-869a95c5-6f40-4a82-aad9-4e3e342368f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80481) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 13:55:14.894479 dv-cinder-797970-4-smb devstack@keystone.service[80481]: [pid: 80481|app: 0|req: 1475/2922] 10.222.0.64 () {58 vars in 1232 bytes} [Tue Jul 12 13:55:14 2022] DELETE /identity/v3/projects/45da1df31c404c8bb8ed9c4271d47471 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 13:55:24.552730 dv-cinder-797970-4-smb devstack@keystone.service[80482]: DEBUG dbcounter [-] [80482] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80482) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 13:55:24.891429 dv-cinder-797970-4-smb devstack@keystone.service[80481]: DEBUG dbcounter [-] [80481] Writing DB stats keystone:DELETE=2,keystone:SELECT=3 {{(pid=80481) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}